Papers with translation quality
Fully Quantized Transformer for Machine Translation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art neural machine translation methods use huge amounts of parameters. |
| Approach: | They propose an all-inclusive quantization strategy for the Transformer to reduce computational costs and improve translation quality. |
| Outcome: | The proposed method achieves state-of-the-art results on most tasks compared to previous methods . |
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset (2024.lrec-main)
Copied to clipboard
Xinyu Ma, Xuebo Liu, Derek F. Wong, Jun Rao, Bei Li, Liang Ding, Lidia S. Chao, Dacheng Tao, Min Zhang
| Challenge: | Existing studies have shown that visual information in existing MMT datasets is insufficient, causing models to disregard it and overestimate their capabilities. |
| Approach: | They propose to use 3AM to create an ambiguity-aware multimodal machine translation dataset. |
| Outcome: | The proposed dataset includes more ambiguity and a greater variety of captions and images than other MMT datasets. |
Context-Aware Neural Machine Translation Decoding (D19-65)
Copied to clipboard
| Challenge: | Existing approaches to enhance neural machine translation systems to take into account document-level information make the training process slower or require document- level annotated data. |
| Approach: | They propose a decoding architecture that fuses the semantic space language model and a neural translation model. |
| Outcome: | The proposed approach improves translation quality for English–Spanish using BLEU and METEOR. |
End-to-End Evaluation for Low-Latency Simultaneous Speech Translation (2023.emnlp-demo)
Copied to clipboard
Christian Huber, Tu Anh Dinh, Carlos Mullov, Ngoc-Quan Pham, Thai Binh Nguyen, Fabian Retkowski, Stefan Constantin, Enes Ugan, Danni Liu, Zhaolin Li, Sai Koneru, Jan Niehues, Alexander Waibel
| Challenge: | a framework to evaluate low-latency speech translations is currently only limited to specific aspects and is not able to compare different approaches. |
| Approach: | They propose a framework to perform and evaluate low-latency speech translation in realistic conditions. |
| Outcome: | The proposed framework evaluates various aspects of low-latency speech translation under realistic conditions. |
IntelliCAT: Intelligent Machine Translation Post-Editing with Quality Estimation and Translation Suggestion (2021.acl-demo)
Copied to clipboard
| Challenge: | Existing computer-aided translation tools require the translator to edit incorrect parts of a document, while ITP tools require fewer edits. |
| Approach: | They propose an interactive translation interface with neural models that streamline the post-editing process on machine translation output. |
| Outcome: | The proposed interface can significantly improve translation quality and a user study shows that it speeds up the post-editing process by 52.9% compared to translating from scratch. |
Compact and Robust Models for Japanese-English Character-level Machine Translation (D19-52)
Copied to clipboard
| Challenge: | In recent years, neural machine translation (NMT) has made a great progress, and its translation quality has far surpassed the conventional statistical machine translation. |
| Approach: | They propose a character-level translation model which is mid-gated and multi-attention model for Japanese-English translation and propose to train them using a relatively narrow beam of width 4 or 5 . |
| Outcome: | The proposed models can translate the word containing Katakana by coining out a close word, and the model can produce tolerable results for noised sentences. |
KreolMorisienMT: A Dataset for Mauritian Creole Machine Translation (2022.findings-aacl)
Copied to clipboard
| Challenge: | Mauritian Creole is a French-based creole and a lingua franca of the Republic of Mauritius. |
| Approach: | They describe a dataset for benchmarking machine translation quality of Mauritian Creole. |
| Outcome: | The proposed dataset compares KreolMorisienMT with existing models and human evaluation reveals the systems’ high translation quality. |
Recursive Neural Network Based Preordering for English-to-Japanese Machine Translation (P18-3)
Copied to clipboard
| Challenge: | Existing methods for preordering require a manual feature design, making language dependent design difficult. |
| Approach: | They propose a preordering method with recursive neural networks that learn features from raw inputs. |
| Outcome: | The proposed method is comparable to the state-of-the-art method but without a manual feature design. |
Machine Translation for Low-Resource Languages through Monolingual Data and LLM: A Case Study of English-to-Basque (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing LLMs do not translate well from English to Basque, but they yield an acceptable performance in the reverse direction. |
| Approach: | They propose to use a Basque monolingual corpora to train an LLM-based MT system . they use 'sovereignty fine tuning' to generate parallel corporata, and then use preference optimization . |
| Outcome: | The proposed system improves translation quality in English-to-Basque direction while requiring limited data for low-resource languages. |
Exploring In-Image Machine Translation with Real-World Background (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing models for IIMT focus on simplified scenarios, which is far from reality and impractical for applications in the real world. |
| Approach: | They propose a model that separates the background and text-image from the source image and performs translation on the text- image directly. |
| Outcome: | The proposed model improves translation quality and visual effect in complex scenarios . it separates background and text-image from source image and performs translation on the text- image directly . |
Triangular Architecture for Rare Language Translation (P18-1)
Copied to clipboard
| Challenge: | Empirical results show that Neural Machine Translation (NMT) performs poor on low-resource pairs especially when Z is a rare language. |
| Approach: | They propose a triangular triangulation technique to leverage bilingual data to optimize the translation performance of low-resource pairs. |
| Outcome: | Empirical results show that the proposed architecture significantly improves translation quality of rare languages on MultiUN and IWSLT2012 datasets and even better when combining back-translation methods. |
Probing Word Translations in the Transformer and Trading Decoder for Encoder Layers (2021.naacl-main)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) has attracted wide attention in recent years. |
| Approach: | They propose a probing-based approach to measure word translation accuracy using transformer layers. |
| Outcome: | The proposed model outperforms previous probing-based translation models. |
MT-Telescope: An interactive platform for contrastive evaluation of MT systems (2021.acl-demo)
Copied to clipboard
| Challenge: | MT-Telescope is an open source, written in Python, and is built around a user friendly and dynamic web interface. |
| Approach: | They propose a platform to facilitate comparative analysis of the output quality of two Machine Translation (MT) systems. |
| Outcome: | The proposed platform supports fine-grained segment-level analysis and interactive visualisations that expose the fundamental differences in the performance of the compared systems. |
Simpson’s Paradox and the Accuracy-Fluency Tradeoff in Translation (2024.acl-short)
Copied to clipboard
| Challenge: | Existing studies suggest that accuracy and fluency should trade off against each other, and that capturing every detail of the source is difficult for human raters to distinguish. |
| Approach: | They propose to evaluate the relationship between accuracy and fluency at the segment level and to use probabilities to estimate probabilities. |
| Outcome: | The proposed model relies on human judgments of accuracy and fluency collected in prior work on translation quality estimation. |
Constructing Multilingual Code Search Dataset Using Neural Machine Translation (2023.acl-srw)
Copied to clipboard
| Challenge: | Existing datasets for code search are monolingual, but their query data are only in English. |
| Approach: | They construct a multilingual code search dataset in four natural and four programming languages using a neural machine translation model and apply back-translation data filtering to it. |
| Outcome: | The proposed model pre-trained with all natural and programming language data performs best under almost all settings. |
Global Voices: Crossing Borders in Automatic News Summarization (D19-54)
Copied to clipboard
| Challenge: | a crowd-sourced dataset is needed to evaluate cross-lingual summarization methods . human-written summarizing is expensive and difficult to design for humans . |
| Approach: | They construct a multilingual dataset for evaluating cross-lingual summarization methods . they use social-network descriptions of news articles to extract evaluation data . |
| Outcome: | The proposed dataset compares a translate-then-summarize approach with baselines in 15 languages. |
On the use of BERT for Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | Existing studies on using pretrained language models for supervised NMT have not been successful. |
| Approach: | They propose to integrate BERT pretrained models with supervised NMT models by using monolingual data. |
| Outcome: | The proposed models improve translation quality in English-German, English-Russian and IWSLT14 datasets. |
Neural Machine Translation System using a Content-equivalently Translated Parallel Corpus for the Newswire Translation Tasks at WAT 2019 (D19-52)
Copied to clipboard
| Challenge: | In addition to the JIJI Corpus, we developed a corpus of 0.22M sentence pairs by manually, translating Japanese news sentences into English content- equivalently. |
| Approach: | They propose to use JIJI Corpus and Equivalent-style sentences to translate Japanese news sentences into English content- equivalently. |
| Outcome: | The proposed translation models achieved the best human evaluation scores in the newswire translation tasks at WAT 2019 . they used the JIJI Corpus, which was provided by the task organizer, and the Equivalent-style translation model to translate Japanese news sentences into English content- equivalently. |
Analysing the Correlation between Lexical Ambiguity and Translation Quality in a Multimodal Setting using WordNet (2022.naacl-srw)
Copied to clipboard
| Challenge: | Recent studies in machine translation have been focusing on using visual information to improve the translation quality of sentences. |
| Approach: | They propose to use visual information to improve the output quality of a text-based translation model by extracting ambiguity scores from WordNet. |
| Outcome: | The proposed model improves translation quality for all sentences in the English-German dataset. |
Cross-lingual Supervision Improves Unsupervised Neural Machine Translation (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing models that use only monolingual data have not been fully duplicated in the vast majority of language pairs, especially for zero-source languages. |
| Approach: | They propose to leverage the corpus from En-Fr and En-De to collectively train the translation from one language into many languages under one model. |
| Outcome: | The proposed model significantly improves translation quality with a big margin in the benchmark unsupervised translation tasks and achieves comparable performance to supervised NMT. |
Can Neural Machine Translation be Improved with User Feedback? (N18-3)
Copied to clipboard
| Challenge: | a recent study has focused on the use of explicit and implicit feedback for neural machine translation (NMT) a new study uses explicit and implied feedback to improve performance of NMT with human reinforcement. |
| Approach: | They propose to use real logged feedback to improve neural machine translation with human reinforcement. |
| Outcome: | The proposed method improves translation quality metrics with implicit task-based feedback . the proposed method is based on explicit and implicit feedback collected on the eBay platform . |
Topic-guided Example Selection for Domain Adaptation in LLM-based Machine Translation (2024.eacl-srw)
Copied to clipboard
| Challenge: | Current machine translation (MT) systems perform well in domains on which they were trained, but adaptation to unseen domains remains a challenge. |
| Approach: | They propose to use large language models to adapt to unseen domains by in-context example selection. |
| Outcome: | The proposed method outperforms baselines on multilingual out-of-domain tests, though it does not match performance with strong baselines for the in-language setting. |
Training with Adversaries to Improve Faithfulness of Attention in Neural Machine Translation (2020.aacl-srw)
Copied to clipboard
| Challenge: | Existing approaches to measure faithfulness of neural machine translation models are based on stress tests and a novel objective that rewards faithful behaviour by the model through probability divergence. |
| Approach: | They propose a measure of faithfulness for neural machine translation models based on stress tests and measuring faithfulness based upon how often the model output changes. |
| Outcome: | The proposed objective increases faithfulness without reducing translation quality and can even improve translation quality in some cases. |
Autocorrect in the Process of Translation — Multi-task Learning Improves Dialogue Machine Translation (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing neural machine translation models are not able to translate dialogues in real life scenarios. |
| Approach: | They propose a joint learning method to identify omission and typos and utilize context to translate dialogue utterances. |
| Outcome: | The proposed method improves translation quality by 3.2 BLEU over baselines and recovers omitted pronouns by 47.16%. |
ViDove: A Translation Agent System with Multimodal Context and Memory-Augmented Reasoning (2025.emnlp-demos)
Copied to clipboard
Yichen Lu, Wei Dai, Jiaen Liu, Ching Wing Kwok, Zongheng Wu, Xudong Xiao, Ao Sun, Sheng Fu, Jianyuan Zhan, Yian Wang, Takatomo Saito, Sicheng Lai
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated remarkable capabilities in Machine Translation (MT) tasks. |
| Approach: | They propose a translation agent system designed for multimodal input that leverages visual and contextual background information to enhance the translation process. |
| Outcome: | The proposed translation agent achieves significantly higher translation quality in subtitle generation and general translation tasks compared to previous state-of-the-art systems. |
Adaptively Scheduled Multitask Learning: The Case of Low-Resource Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | Neural Machine Translation suffers from the lack of bilingual data in low-resource scenarios. |
| Approach: | They propose to inject inductive biases into Neural Machine Translation (NMT) using auxiliary syntactic and semantic tasks. |
| Outcome: | The proposed approach improves translation quality by reweighing training data of main and auxiliary tasks based on their contributions to generalisability of main task. |
Sentence Concatenation Approach to Data Augmentation for Neural Machine Translation (2021.naacl-srw)
Copied to clipboard
| Challenge: | Neural machine translation is known to show poor performance at long sentence translations . however, when the sentence length exceeds a certain value, the quality of NMT becomes inferior to that of statistical machine translation. |
| Approach: | They propose a method that uses given parallel corpora as train data to generate long sentences by concatenating two sentences at random. |
| Outcome: | The proposed method improves translation quality more when combined with back-translation. |
EDITOR: An Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints (2021.tacl-1)
Copied to clipboard
| Challenge: | Empirically, EDITOR uses soft lexical constraints more effectively than the Levenshtein Transformer while speeding up decoding dramatically compared to constrained beam search. |
| Approach: | They propose an Edit-Based TransfOrmer with Repositioning that integrates lexical preferences into output sequences by iterative editing hypotheses. |
| Outcome: | The proposed model uses soft lexical constraints more effectively than the Levenshtein Transformer while speeding up decoding dramatically compared to constrained beam search. |
Observing the Learning Curve of NMT Systems With Regard to Linguistic Phenomena (2021.acl-srw)
Copied to clipboard
| Challenge: | Using a semi-automatic process, we observe the linguistic performance of various neural machine translation models. |
| Approach: | They observe the linguistic performance of a neural machine translation model on several steps on the training process. |
| Outcome: | The proposed system performs well on training of English-to-German models. |
OpusFilter: A Configurable Parallel Corpus Filtering Toolbox (2020.acl-demos)
Copied to clipboard
| Challenge: | OpusFilter is a toolbox for filtering parallel corpora using noisy training data. |
| Approach: | They propose a toolbox for filtering parallel corpora with heuristic filters, language identification libraries, character-based language models and word alignment tools. |
| Outcome: | The proposed tool outperforms a similar tool on a Finnish-English news translation task using noisy web crawls. |
Japanese-Russian TMU Neural Machine Translation System using Multilingual Model for WAT 2019 (D19-52)
Copied to clipboard
| Challenge: | Using parallel corpora of different language pairs as training data is effective for multilingual neural machine translation model in extremely low resource situations. |
| Approach: | They propose to use Japanese-English and English-Russian parallel corpora as training data for their system to improve JapaneseRussian news translation. |
| Outcome: | The proposed system improves translation quality for JapaneseRussian language pairs in low resource situations. |
CytonMT: an Efficient Neural Machine Translation Open-source Toolkit Implemented in C++ (D18-2)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has made remarkable progress over the past few years. |
| Approach: | They propose to use C++ and NVIDIA’s GPU-accelerated libraries to build an open-source neural machine translation toolkit called CytonMT. |
| Outcome: | The proposed toolkit accelerates the training speed by 64.5% to 110.8% on neural networks of various sizes, and achieves competitive translation quality. |
Better Chinese Sentence Segmentation with Reinforcement Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Chinese-English machine translation systems use ambiguous sentence boundaries, but English and Chinese use different orthographic conventions to designate sentence boundaries. |
| Approach: | They propose a segmentation policy that splits Chinese texts into segments that can be independently translated to maximise translation quality. |
| Outcome: | The proposed method improves the baseline BLEU score on the Chinese-English news translation task by +0.3 BLUE overall and the score on input segments that contain more than 60 words by +3 BL EU. |
Continual Quality Estimation with Online Bayesian Meta-Learning (2021.acl-short)
Copied to clipboard
| Challenge: | Existing quality estimation models for machine translation are trained and evaluated in a static setting . however, in real-life settings, test data may differ from training data . |
| Approach: | They propose an online Bayesian meta-learning framework for continuous training of QE models that adapts to the needs of different users while being robust to distributional shifts in training and test data. |
| Outcome: | The proposed framework adapts to the needs of different users while being robust to distributional shifts in training and test data. |
Benchmarking Diffusion Models for Machine Translation (2024.eacl-srw)
Copied to clipboard
| Challenge: | Diffusion models have shown great potential on many generative tasks, but their application to natural language processing (NLP) is still a less explored direction. |
| Approach: | They adapt two diffusion-based text generation models, Diffusion-LM and DiffuSeq, to perform machine translation. |
| Outcome: | The proposed models struggle more on long-range dependencies than other models. |
Dubbing in Practice: A Large Scale Study of Human Localization With Insights for Automatic Dubbing (2023.tacl-1)
Copied to clipboard
| Challenge: | a large-scale study of human dubbing in practice is lacking in qualitative literature on human dubs . authors argue for vocal naturalness and translation quality over isometric constraints . a data-driven examination of the way humans perform this task is needed . |
| Approach: | They analyze 319.57 hours of video from 54 professionally produced titles . they argue for vocal naturalness and translation quality over isometric constraints . authors say they need to preserve speech characteristics and transfer of semantic properties . |
| Outcome: | The study challenges assumptions in qualitative and machine-learning literature on dubbing . it also finds that source-side audio influences human dubbing through other channels . |
Neural Machine Translation for Agglutinative Languages via Data Rejuvenation (2025.acl-srw)
Copied to clipboard
| Challenge: | Recent years, advances in Neural Machine Translation (NMT) heavily rely on large-scale parallel corpora. |
| Approach: | They propose to combine fine-grained inactive sample identification with target-side rejuvenation to improve translation quality from agglutinative languages. |
| Outcome: | The proposed framework improves on four low-resource agglutinative language tasks. |
Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappings (2026.tacl-1)
Copied to clipboard
Miguel Moura Ramos, Tomás Almeida, Daniel Vareta, Filipe Azevedo, Sweta Agrawal, Patrick Fernandes, André F. T. Martins
| Challenge: | Reinforcement learning (RL) is an effective and robust method for training neural machine translation systems. |
| Approach: | They propose a method that leverages fine-grained, token-level quality assessments . they use a state-of-the-art quality estimation system as their token- level reward model . |
| Outcome: | The proposed approach leverages fine-grained, token-level quality assessments along with error severity levels to improve translation quality. |
A Stable and Effective Learning Strategy for Trainable Greedy Decoding (D18-1)
Copied to clipboard
| Challenge: | Existing methods for decoding text using beam search are expensive and require reinforcement learning. |
| Approach: | They propose a method that allows us to reap the full benefits of beam search with no additional computational cost. |
| Outcome: | The proposed method outperforms greedy decoding and beam search on machine translation tasks with minimal computational cost. |
Addressing Troublesome Words in Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has weaknesses in handling lowfrequency and ambiguous words, which we refer to as troublesome words. |
| Approach: | They propose to use contextual memory to memorize which target words should be produced in which situations to translate troublesome words. |
| Outcome: | The proposed method outperforms baseline models on Chinese-to-English and English-to German translation tasks. |
Jointly Masked Sequence-to-Sequence Model for Non-Autoregressive Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | masked language models have been used for natural language processing tasks but few studies have adopted it in the sequence-to-sequence models. |
| Approach: | They propose to combine encoder and decoder to train a masked sequence-to-sequence model . they propose to train the encoder more rigorously by masking the encoded input . |
| Outcome: | The proposed model achieves 27.69/32.24 BLEU scores on English-German/German-English tasks with 5+ times speed up compared with an autoregressive model. |
End-to-End Multilingual Automatic Dubbing via Duration-based Translation with Large Language Models (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Automatic dubbing (AD) aims to replace the original speech with translated speech that maintains precise temporal alignment (isochrony). |
| Approach: | They propose an end-to-end automatic dubbing framework that leverages large language models to integrate translation and timing control seamlessly. |
| Outcome: | The proposed framework achieves up to 24% relative gains on English, Spanish, and Korean language pairs while maintaining competitive translation quality measured by COMET scores. |
Checkpoint Reranking: An Approach to Select Better Hypothesis for Neural Machine Translation Systems (2020.acl-srw)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) has produced excellent results in the field of machine translation due to generation of high-quality translations for different language pairs. |
| Approach: | They propose a method of re-ranking the outputs of Neural Machine Translation systems by focusing on the decoder's ability to generate distinct tokens and without the use of any language model or data. |
| Outcome: | The proposed method achieves translation improvement up to +0.16 BLEU points over baseline. |
Multiscale Collaborative Deep Models for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural machine translation models with deeper neural networks are difficult to train. |
| Approach: | They propose a MultiScale Collaborative framework to boost gradient back-propagation . they let each encoder block learn a fine-grained representation and enhance it . |
| Outcome: | The proposed framework outperforms baseline models on translation tasks with three translation directions and achieves a BLEU score of 30.56 on the English-to-German task. |
Back-Translation Sampling by Targeting Difficult Words in Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) uses a sequence-to-sequence model to generate synthetic data. |
| Approach: | They propose a method that adds synthetic data to sentences with high prediction loss during training and a variety of sampling strategies targeting difficult-to-predict words. |
| Outcome: | The proposed method improves translation quality by up to 1.7 and 1.2 Bleu points over back-translation using random sampling for German-English and English-German, respectively. |
Machine translation Evaluation Eng-Thai MQM Ranking dataset (2026.eacl-short)
Copied to clipboard
Phichet Phuangrot, Natdanai Trintawat, Kanawat Vilasri, Yanapat Patcharawiwatpong, Pachara Boonsarngsuk, Nat Pavasant, Ekapol Chuangsuwanich
| Challenge: | MEET-MR provides a comprehensive benchmark for evaluating English–Thai machine translation systems. |
| Approach: | They propose a benchmark for evaluating English–Thai machine translation systems . they use the Multidimensional Quality Metrics framework to provide fine-grained human judgements of translation quality. |
| Outcome: | The dataset covers nine domains providing linguistic and contextual diversity. |
Thesis Proposal: Development of End-to-End Speech Translation Models for Indian Languages (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing approaches to speech-to-speech translation rely on cascaded pipelines . current approaches rely only on text representations, but they suffer from errors and latency . a new direct speech translation framework is proposed to bridge linguistic gaps . |
| Approach: | They propose a sequence-to-sequence direct speech translation framework that can translate speech from one Indian language to another without relying on intermediate text representations. |
| Outcome: | The proposed framework can translate speech from one Indian language to another without relying on intermediate text representations. |
Opportunistic Decoding with Timely Correction for Simultaneous Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to balancing translation quality and latency are either too aggressive or too conservative. |
| Approach: | They propose an opportunistic decoding technique that always (over-)generates a certain mount of extra words at each step to keep the audience on track with the latest information. |
| Outcome: | The proposed technique reduces latency and increases BLEU with no over-generating . it also corrects mistakes in the overgenerated words when observing more context . |
Lost in Machine Translation: A Method to Reduce Meaning Loss (N19-1)
Copied to clipboard
| Challenge: | state-of-the-art translation systems often fail in preserving meaning . ambiguity between source and target languages can cause translation problems . |
| Approach: | They propose to use a pre-trained neural sequence-to-sequence model to define a less ambiguous translation system. |
| Outcome: | The proposed system preserves meaning in two languages without compromising translation quality. |
Semi-Autoregressive Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to neural machine translation are typically autoregressive but suffer from low parallelizability and thus slow at decoding long sequences. |
| Approach: | They propose a semi-autoregressive Transformer model for fast sequence generation that keeps the autoregressive property in global but relieves in local . |
| Outcome: | The proposed model achieves 5.58 speedup while maintaining 88% translation quality, significantly better than previous non-autoregressive methods. |
Non-Autoregressive Neural Machine Translation with Consistency Regularization Optimized Variational Framework (2022.naacl-main)
Copied to clipboard
| Challenge: | Variational Autoencoder (VAE) is an effective framework to model the interdependency for non-autoregressive neural machine translation (NAT). |
| Approach: | They propose to use Variational Autoencoder to model interdependency for non-autoregressive neural machine translation (NAT) a posterior consistency regularization approach is proposed to improve translation quality . |
| Outcome: | The proposed model is 1.5/0.7 and 0.8/0.3 BLEU points faster than the baseline model. |
Synthesizing Parallel Data of User-Generated Texts with Zero-Shot Neural Machine Translation (2020.tacl-1)
Copied to clipboard
| Challenge: | Neural machine translation systems are usually trained on clean parallel data, but the quality of translations is poor when translating noisy texts. |
| Approach: | They synthesize parallel data of UGT and exploit monolingual data to generate translations . they propose to use monolingual parallel data to train or adapt NMT systems . |
| Outcome: | The proposed approach improves the translation quality of noisy texts while making them more robust. |
Understanding and Improving Hidden Representations for Neural Machine Translation (N19-1)
Copied to clipboard
| Challenge: | Existing studies have explored some methods for understanding hidden representations, but they have not sought to improve the translation quality rationally according to their understanding. |
| Approach: | They propose to construct a sequence of nested relative tasks and measure the feature generalization ability of the learned hidden representation over these tasks. |
| Outcome: | The proposed methods achieve consistent improvements (up to +1.3 BLEU) on two widely-used datasets. |
A Hybrid Approach for Automatic Extraction of Bilingual Multiword Expressions from Parallel Corpora (L18-1)
Copied to clipboard
| Challenge: | Specific-domain bilingual lexicons are composed of MultiWord Expressions (MWEs) the manual construction of MWEs bilingual dictionaries is costly and time-consuming. |
| Approach: | They propose to use word alignment approaches to automatically construct bilingual lexicons of MWEs from parallel corpora by formalizing the alignment process as an integer linear programming problem. |
| Outcome: | The proposed approach extracts and aligns multiword expressions from parallel corpora and then filters them using linguistic patterns to build bilingual lexicons. |
High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics (2022.tacl-1)
Copied to clipboard
| Challenge: | Neural machine translations are ranked below human translations in professional evaluations . |
| Approach: | They apply minimum bayes risk decoding to optimize different metrics of translation quality . they show that model estimates and translation quality only vaguely correlate . |
| Outcome: | The proposed method improves human translations with different models and metric. |
Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that attention heads learn simple positional patterns . |
| Approach: | They propose to replace all but one attention head of each encoder layer with simple fixed – non-learnable – attentive patterns that are solely based on position and do not require external knowledge. |
| Outcome: | The proposed model improves translation quality and improves BLEU scores by up to 3 points in low-resource scenarios. |
Learning When to Translate for Streaming Speech (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods waiting-and-translating for a fixed duration break speech acoustic units . Existing models waiting-for a set duration and generating partial sentences are not effective . |
| Approach: | They propose a monotonic segmentation module inside an encoder-decoder model to detect proper speech unit boundaries for a streaming speech input. |
| Outcome: | The proposed method outperforms existing methods on a speech translation dataset and achieves the best trade-off between translation quality and latency. |
A Comparison of Transformer and Recurrent Neural Networks on Multilingual Neural Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Recent studies have shown that multilingual NMT models can handle more than one translation direction with a single system. |
| Approach: | They propose a multilingual neural machine translation model that can handle more than one translation direction with a single system. |
| Outcome: | The proposed model performs well in low-resource settings against bilingual systems. |
Machine Translation for Livonian: Catering to 20 Speakers (2022.acl-short)
Copied to clipboard
| Challenge: | Livonian is one of the most endangered languages in Europe with just a tiny handful of speakers and virtually no publicly available corpora. |
| Approach: | They aim to develop machine translation between Livonian and English using a linguistic similarity test and a dataset of parallel and monolingual data. |
| Outcome: | The proposed systems and the collected data, including a manually translated and verified translation benchmark, are publicly released via OPUS and Huggingface repositories. |
Stream-level Latency Evaluation for Simultaneous Machine Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Simultaneous machine translation systems need to find a trade-off between translation quality and response time. |
| Approach: | They propose to adapt existing translation latency measures to streaming scenarios by re-segmenting the output translation to take into account sequential nature of streaming scenarios. |
| Outcome: | The proposed measures are evaluated on a streaming task on simulated speech translation systems. |
Learning Hard Retrieval Decoder Attention for Transformers (2021.findings-emnlp)
Copied to clipboard
| Challenge: | In this paper, we show that learning a hard retrieval attention that attends to a single token in a sentence is 1.43 times faster than the standard scaled dot-product attention. |
| Approach: | They propose a method to learn hard retrieval attention where an attention head attends to a single token in a sentence rather than all tokens. |
| Outcome: | The proposed method is 1.43 times faster in decoding while preserving translation quality on a wide range of MT tasks. |
Ready to Translate, Not to Represent? Bias and Performance Gaps in Multilingual LLMs Across Language Families and Domains (2026.findings-acl)
Copied to clipboard
Md. Faiyaz Abdullah Sayeedi, Subhey Sadi Rahman, Md. Mahbub Alam, Md. Adnanul Islam, Jannatul Ferdous Deepti, Tasnim Mohiuddin, Md Mofijul Islam, Swakkhar Shatabda
| Challenge: | Large Language Models (LLMs) have redefined Machine Translation, enabling context-aware and fluent translations across hundreds of languages and textual domains. |
| Approach: | They propose a framework and dataset to evaluate the translation quality and fairness of open-source LLMs. |
| Outcome: | The proposed framework and dataset evaluates translation quality and fairness of open-source LLMs. |
Latent Part-of-Speech Sequences for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Existing methods for learning target side syntactic structure are greedy and only allow them to explore a limited portion of the latent space. |
| Approach: | They propose a new latent variable model, LaSyn, that captures the co-dependence between syntax and semantics while allowing for effective inference over the latent space. |
| Outcome: | The proposed model captures the co-dependence between syntax and semantics while allowing for efficient inference over the latent space. |
Beyond English: The Impact of Prompt Translation Strategies across Languages and Tasks in Multilingual LLMs (2025.findings-naacl)
Copied to clipboard
| Challenge: | Current LLMs are primarily trained on English data but also include data from other languages. |
| Approach: | They propose to use a pre-translation strategy to translate a task prompt into English before inference . they use 'a modular entity' that could be translated into four different languages . |
| Outcome: | The proposed strategies are based on a set of pre-trained data across 35 languages covering both low and high-resource languages. |
Iterative Refinement in the Continuous Space for Non-Autoregressive Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive inference procedures that refine in token space often require computational overhead. |
| Approach: | They propose an efficient inference procedure that iteratively refines translation purely in the continuous space using a latent variable instead of the latent variables. |
| Outcome: | The proposed procedure is twice as efficient and more effective than the existing EM-like inference procedure. |
Self-Attention with Relative Position Representations (N18-2)
Copied to clipboard
| Challenge: | Recent approaches to sequence to sequence learning leverage recurrence, convolution, attention or combination of recurrent and convolutional neural networks. |
| Approach: | They propose an approach that extends the self-attention mechanism to consider representations of relative positions, or distances between sequence elements. |
| Outcome: | The proposed approach yields 1.3 BLEU and 0.3 BLUE on translation tasks . it is based on a relation-aware self-attention mechanism that can generalize to arbitrary graph-labeled inputs. |
Detect, Disambiguate, and Translate: On-Demand Visual Reasoning for Multimodal Machine Translation with Large Vision-Language Models (2025.naacl-long)
Copied to clipboard
Danyang Liu, Fanjie Kong, Xiaohang Sun, Dhruva Patil, Avijit Vajpayee, Zhu Liu, Vimal Bhat, Najmeh Sadoughi
| Challenge: | Multimodal machine translation (MMT) aims to leverage additional modalities beyond text . current MMT systems rely heavily on monolingual English captioning data . |
| Approach: | They propose a reasoning-based framework to leverage large-scale vision-language models for MMT . they propose Detect, Disambiguate, and Translate framework to detect ambiguity in input sentence . |
| Outcome: | The proposed framework outperforms state-of-the-art models in disambiguation accuracy and translation quality. |
Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation (2022.acl-short)
Copied to clipboard
| Challenge: | Label smoothing and vocabulary sharing are widely used in neural machine translation models, but they can be conflicting and lead to suboptimal performance. |
| Approach: | They propose a mechanism that masks the soft label probability of source-side words to zero and integrates label smoothing with vocabulary sharing to improve translation quality. |
| Outcome: | The proposed mechanism improves translation quality and model calibration on bilingual and multilingual datasets, while retaining the original smoothing method. |
Multi-task Learning for Multilingual Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing multilingual neural machine translation systems rely on bitext training data, which is limited and costly to collect. |
| Approach: | They propose a multi-task learning framework that trains the model with the translation task on bitext data and two denoising tasks on monolingual data. |
| Outcome: | The proposed framework outperforms pre-training models for both NMT and cross-lingual transfer learning NLU tasks. |
Discourse Graph Guided Document Translation with Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent agentic machine translation systems mitigate context window constraints but require substantial computational resources and are sensitive to memory retrieval strategies. |
| Approach: | They propose a framework that explicitly models inter-chunk relationships through structured discourse graphs and selectively conditions each translation segment on relevant graph neighbourhoods rather than sequential or exhaustive context. |
| Outcome: | The proposed framework surpasses strong baselines in translation quality and terminology consistency while incurring significantly lower token overhead. |
Multi-agent Learning for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Experimental results show that training with more than one agent improves translation quality and improves accuracy. |
| Approach: | They propose to introduce diverse agents in an in- teractive updating process to train NMT models with an additional agent. |
| Outcome: | The proposed approach improves on NIST Chinese-English, IWSLT 2014 German- English, WMT 2014 English-German translation tasks and shows competitive performance on all tasks. |
Analysis on Unsupervised Acquisition Process of Bilingual Vocabulary through Iterative Back-Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have demonstrated the effectiveness of iterative back-translation, but its reason has not been sufficiently elucidated. |
| Approach: | They propose a method for machine translation known as iterative back-translation . they use two monolingual data to create a pseudo-bilingual data and update translation models . |
| Outcome: | The proposed method improves translation quality and improves BLEU. |
Hierarchical Policy Optimization for Simultaneous Translation of Unbounded Speech (2026.acl-long)
Copied to clipboard
| Challenge: | Existing synthesis methods cannot guarantee data quality. |
| Approach: | They propose a hierarchical reward that balances translation quality and latency objectives by combining supervised fine-tuning data with supervised inputs. |
| Outcome: | The proposed model can reuse key-value caches across both modalities and eliminate redundant feature recomputation. |
Self-Paced Learning for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown that the training of neural machine translation (NMT) rely on the quality of artificial schedule drawn up with the handcrafted features, e.g. sentence length or word rarity. |
| Approach: | They propose to train NMT model using a self-paced learning approach that allows it to quantify the learning confidence over training examples and flexibly govern its learning via regulating the loss in each iteration step. |
| Outcome: | The proposed model outperforms baseline models and those trained with human-designed curricula on translation quality and convergence speed. |
Generating Diverse Translation from Model Distribution with Dropout (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing neural machine translation models lack diversity in their generation. |
| Approach: | They propose to generate diverse translations by deriving Bayesian models and sampling models from them for inference. |
| Outcome: | The proposed method makes a better trade-off between diversity and accuracy. |
Bicleaner AI: Bicleaner Goes Neural (2022.lrec-1)
Copied to clipboard
| Challenge: | a new version of Bicleaner detects noisy sentences in parallel corpora . the tool is based on pre-trained transformer-based language models fine-tuned on a binary classification task. |
| Approach: | They propose to use Bicleaner AI to detect noisy sentences in parallel corpora . they use pre-trained transformer-based language models fine-tuned on a binary classification task . |
| Outcome: | The proposed tool improves translation quality and reduces manual cleaning steps. |
The Multilingual Microblog Translation Corpus: Improving and Evaluating Translation of User-Generated Text (2022.lrec-1)
Copied to clipboard
| Challenge: | a corpus of over 200,000 microblog translations supports translation of thirteen languages into English . large collections of parallel text, or bitext, are increasingly available in many languages . |
| Approach: | They propose a corpus of over 200,000 microblog posts that supports translation of thirteen languages into English. |
| Outcome: | The proposed corpus contains over 200,000 translations of microblog posts in 13 languages . fine-tuning showed significant improvements in translation quality . |
Meet Changes with Constancy: Learning Invariance in Multi-Source Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to multi-source neural machine translation neglect inconsistencies between sources of information. |
| Approach: | They propose a source invariance network to learn invariant information of parallel sources . they propose to integrate such network with multi-encoder based multi-source NMT methods . |
| Outcome: | The proposed approach achieves clear gains in translation quality and captures implicit invariance between different sources. |
An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent years have witnessed that massively multilingual neural machine translation (MMNMT) achieves a remarkable progress in both high- and low-resource language translation. |
| Approach: | They propose to use a robustness evaluation benchmark dataset to assess the translation robustness of Indonesian-Chinese translation in the face of various naturally occurring noise. |
| Outcome: | The proposed dataset is publicly available at https://github.com/ID-ZH-MTRobustEval. |
Compact Personalized Models for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | a large proportion of model parameters can be frozen during adaptation with minimal or no reduction in translation quality. |
| Approach: | They propose gradient-based domain adaptation methods for self-attentive machine translation models . they encourage structured sparsity in the set of offset tensors during learning . |
| Outcome: | The proposed method achieves high space and time efficiency using sparse models . the results compare the proposed method with incremental adaptation . |
Enriching Non-Autoregressive Transformer with Syntactic and Semantic Structures for Neural Machine Translation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive models have boosted the efficiency of neural machine translation, but their performance is significantly worse than that of autoregressive counterparts. |
| Approach: | They propose to incorporate syntactic and semantic structures among natural languages into a non-autoregressive Transformer for the task of neural machine translation. |
| Outcome: | The proposed model achieves faster speed and keeps translation quality compared with other models. |
Assessing the Impact of Typological Features on Multilingual Machine Translation in the Age of Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing evidence on the intrinsic difficulty of multilingual modeling is limited to small monolingual models or bilingual models trained from scratch. |
| Approach: | They propose to use typological properties to determine the difficulty of modeling a language . they analyze two large pre-trained multilingual translation models . |
| Outcome: | The proposed models are based on two large pre-trained models of encoder-decoder and decoder-only machine translation. |
PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Simultaneous machine translation (SiMT) requires target tokens to be generated in real-time as streaming source tokens are consumed. |
| Approach: | They propose a zero-shot adaptive read/write policy for siMT that generates target tokens concurrently as streaming source tokens are consumed. |
| Outcome: | The proposed policy achieves performance on par with strong baselines and the P2F method can further enhance performance. |
BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation (2022.naacl-main)
Copied to clipboard
Yuchen Jiang, Tianyu Liu, Shuming Ma, Dongdong Zhang, Jian Yang, Haoyang Huang, Rico Sennrich, Ryan Cotterell, Mrinmaya Sachan, Ming Zhou
| Challenge: | Standard evaluation metrics, e.g., BLEU, TER and METEOR, focus on the quality of translations at the sentence level and do not consider discourse-level features. |
| Approach: | They propose to use a metric to take discourse coherence into consideration by categorizing discourse-related spans and calculating the similarity-based F1 measure of categorized spans. |
| Outcome: | The proposed metric possesses better selectivity and interpretability at the document-level, and is more sensitive to document- level nuances. |
Translation of Multifaceted Data without Re-Training of Machine Translation Systems (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a novel MT pipeline that considers the intra-data relation is proposed . previous MT systems have demonstrated relatively low performance, making them hardly utilized as another data source. |
| Approach: | They propose a new MT pipeline that considers the intra-data relation . they propose CS and IT to enhance the intra data relation based on a data point . |
| Outcome: | The proposed pipeline improves translation quality and training data compared with the existing approach . it yields better training data and better translation quality than previous approaches . |
CTC Alignments Improve Autoregressive Translation (2023.eacl-main)
Copied to clipboard
Brian Yan, Siddharth Dalmia, Yosuke Higuchi, Graham Neubig, Florian Metze, Alan W Black, Shinji Watanabe
| Challenge: | Connectionist Temporal Classification (CTC) is widely used for automatic speech recognition (ASR) but lags behind attentional decoder approaches in terms of translation quality. |
| Approach: | They propose to use a CTC/attention framework to validate this hypothesis by modifying the Hybrid CTC-Attention model proposed for automatic speech recognition to support text-to-text translation (MT) and speech-totext translation. |
| Outcome: | The proposed model outperforms pure-attention baselines across six translation tasks. |
Syntactically Supervised Transformers for Faster Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Standard decoders for neural machine translation generate a single token per timestep, which slows inference . a series of controlled experiments demonstrates that SynST decodes sentences 5x faster than the baseline autoregressive Transformer. |
| Approach: | They propose a syntactically supervised Transformer that generates all target tokens in one shot . synST is a variant of the Transformer architecture that autoregressively predicts a chunked parse tree . |
| Outcome: | The proposed method decodes sentences 5x faster than the baseline method on En-De and En-Fr datasets while achieving higher BLEU scores. |
Representation Collapse in Machine Translation Through the Lens of Angular Dispersion (2026.findings-eacl)
Copied to clipboard
| Challenge: | Effective training of Transformer models for sequential language tasks is difficult due to various forms of collapse of the internal representations learned. |
| Approach: | They propose to use angular dispersion to analyze representation collapse at different levels of discrete and continuous transformers throughout training. |
| Outcome: | The proposed method mitigates collapse and improves translation quality. |
Rethinking the Word-level Quality Estimation for Machine Translation from Human Judgement (2023.findings-acl)
Copied to clipboard
| Challenge: | Word-level Quality Estimation (QE) of Machine Translation aims to detect potential translation errors in the translated sentence without reference. |
| Approach: | They propose to use a human-generated translation judgment to generate a word-level quality estimate (QE) using a translation error rate toolkit to detect translation errors without reference. |
| Outcome: | The proposed dataset is more consistent with human judgment and confirms the effectiveness of the proposed tag-correcting strategies. |
HintedBT: Augmenting Back-Translation with Quality and Transliteration Hints (2021.emnlp-main)
Copied to clipboard
| Challenge: | HintedBT provides hints (as source tags on the encoder) about the quality of each source-target pair. |
| Approach: | They propose a method which provides hints to the encoder and decoder to improve the quality of BT data by providing hints about the quality. |
| Outcome: | The proposed method improves translation quality and performance in three low/medium-resource language pairs. |
A Reinforcement Learning Approach to Improve Low-Resource Machine Translation Leveraging Domain Monolingual Data (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning domain adaptation have overfitting problem in low-resource domains . lack of parallel data makes it difficult for model to learn domain-specific knowledge . |
| Approach: | They propose a Reinforcement Learning Domain Adaptation method for Neural Machine Translation that uses in-domain source monolingual data to make up for the lack of parallel data. |
| Outcome: | The proposed method can alleviate overfitting and reinforce the model to learn domain-specific knowledge. |
Length-aware Byte Pair Encoding for Mitigating Over-segmentation in Korean Machine Translation (2024.findings-acl)
Copied to clipboard
Jungseob Lee, Hyeonseok Moon, Seungjun Lee, Chanjun Park, Sugyeong Eo, Hyunwoong Ko, Jaehyung Seo, Seungyoon Lee, Heuiseok Lim
| Challenge: | Byte Pair Encoding (BPE) is an effective approach in machine translation across several languages, but it is prone to over-segmentation in Korean, an agglutinative and morphologically rich language. |
| Approach: | They propose a new method that incorporates long words into the Korean vocabulary by strategically preserving morphological information and reducing semantic confusion. |
| Outcome: | The proposed method outperforms BPE and surpasses state-of-the-art morpheme-aware tokenization methods. |
The Devil is in the Details: On the Pitfalls of Vocabulary Selection in Neural Machine Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | Neural Machine Translation models can be optimized to improve latency by constraining the set of output words . lexical shortlisting fails to select the right set of input words for semantically non-compositional phenomena such as idiomatic expressions. |
| Approach: | They propose a model of vocabulary selection that constrains the set of allowed output words . they propose to increase the size of the allowed set to restore translation quality . |
| Outcome: | The proposed model restores translation quality of an unconstrained system, as measured by human evaluations on WMT newstest2020 and idiomatic expressions, at an inference latency competitive with alignment-based selection using aggressive thresholds. |
PROSE: A Pronoun Omission Solution for Chinese-English Spoken Language Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Pro-drop (‘pronoun-dropping’) language requires NMT systems to recover omitted pronouns, but this task lacks sufficient datasets for benchmarking . |
| Approach: | They propose a benchmarking method that leverages the semantic embedding of dropped pronouns to augment training pairs to alleviate the negative impact introduced by pro-drop . |
| Outcome: | The proposed method outperforms existing methods regarding omitted pronoun retrieval and overall translation quality on four Chinese-English translation corpora. |
C-XNLI: Croatian Extension of XNLI Dataset (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing parallel datasets limit multilingual evaluations due to the nature of linguistic annotation, which is tedious, subjective, and costly. |
| Approach: | They extend the Cross-lingual Natural Language Inference corpus with Croatian and use Facebook's 1.2B parameter m2m_100 model to analyze the train set and compare its quality with the existing machine-translated German set. |
| Outcome: | The proposed model is consistent with other XNLI dubs and is compared with the existing machine-translated German train set. |
Exploiting Pre-Ordering for Neural Machine Translation (L18-1)
Copied to clipboard
| Challenge: | Existing studies have shown that Neural Machine Translation suffers from the problems that some source words are mistakenly translated for multiple times . |
| Approach: | They propose a pre-ordering approach to solve the under-translation problem by pre-ordnanced source sentences and position embedding to enhance monotone translation. |
| Outcome: | The proposed method significantly improves translation quality by 2.43 BLEU points on Chinese-to-English translation. |
How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts. (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Neural Machine Translation systems are prone to gender biases in their learned representations. |
| Approach: | They propose to use contextual sentences to correct gender bias in Neural Machine Translation models. |
| Outcome: | The proposed method can be used to build better, bias-free translation systems. |
Dynamic Oracle for Neural Machine Translation in Decoding Phase (L18-1)
Copied to clipboard
| Challenge: | Existing methods to improve NMT performance but there is a discrepancy between training and inference when decoding. |
| Approach: | They propose to use Scheduled Sampling to reduce the discrepancy between training and inference in NMT when decoding to mitigate the discrépancy. |
| Outcome: | The proposed methods improve translation quality over standard NMT system. |
End-to-End Neural Word Alignment Outperforms GIZA++ (2020.acl-main)
Copied to clipboard
| Challenge: | Word alignment was once a core unsupervised learning task in natural language processing . but word alignment still plays an important role in interactive applications of neural machine translation, such as annotation transfer and lexicon injection. |
| Approach: | They propose to use a Transformer model to train an unsupervised word alignment model. |
| Outcome: | The proposed method outperforms GIZA++ on three data sets and is tightly integrated and does not affect translation quality. |
Generating Synthetic Speech from SpokenVocab for Speech Translation (2023.findings-eacl)
Copied to clipboard
| Challenge: | End-to-end speech-totext translation (ST) models require large amounts of data to train, but their size is considerably smaller than text-based MT data. |
| Approach: | They propose a method to convert MT data to ST data via text-to-speech systems. |
| Outcome: | The proposed method improves translation quality by an average of 1.83 BLEU score while performing equally well as TTS-generated speech in improving translation quality. |
Enhancing Machine Translation with Dependency-Aware Self-Attention (2020.acl-main)
Copied to clipboard
| Challenge: | Currently, most neural machine translation models rely on pairs of parallel sentences, assuming syntactic information is automatically learned by an attention mechanism. |
| Approach: | They propose a parameter-free, dependency-aware self-attention mechanism that integrates syntactic knowledge into a Transformer model and propose 'a parameter free approach' they also propose - a novel mechanism that improves translation quality for long sentences and in low-resource scenarios. |
| Outcome: | The proposed approach improves translation quality on English-German and English-Turkish translation tasks and in low-resource scenarios. |
Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation (2025.acl-long)
Copied to clipboard
| Challenge: | Maximum a posteriori decoding aims to maximize the estimated posterior probability, but high estimated probability does not always lead to high translation quality. |
| Approach: | They propose a method that seeks hypotheses with the highest expected utility by using quasi-sources as “support hypothese . they propose sMBR decoding which utilizes a reference-free quality estimation metric as the utility function. |
| Outcome: | The proposed approach outperforms QE reranking and the standard MBR decoding. |
Efficient Cluster-Based k-Nearest-Neighbor Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | k-Nearest-Neighbor Machine Translation (kNN-MT) is a non-parametric solution for domain adaptation . previous studies have shown that kNN retrieval is at the expense of high latency . |
| Approach: | They propose to use clustering to improve retrieval efficiency by combining a non-parametric MT with an in-domain feature-based retrieval module. |
| Outcome: | The proposed method reduces translation latency by 57% while maintaining the most useful information of the original datastore. |
Measuring Uncertainty in Translation Quality Evaluation (TQE) (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing automated tools are not good enough to evaluate translation quality . existing tools are often accused of having low reliability and agreement . |
| Approach: | They propose to use a method to accurately estimate the confidence intervals depending on the sample size of the translated text. |
| Outcome: | The proposed method aims to estimate the confidence intervals (CITATION) depending on the sample size of the translated text, e.g. the amount of words or sentences, that needs to be processed on TQE workflow step for confident and reliable evaluation of overall translation quality. |
Alignment verification to improve NMT translation towards highly inflectional languages with limited resources (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to improve translation quality using limited training data are phrase-based and syntax-based approaches. |
| Approach: | They propose to combine a neural MT system with an open source module to improve translation quality. |
| Outcome: | The proposed method improves translation quality over the best individual NMT and the standard ensemble system provided in the Marian-NMT system. |
SHIFT: Selected Helpful Informative Frame for Video-guided Machine Translation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Video-guided machine translation (VMT) aims to improve translation quality by integrating contextual information from paired short video clips. |
| Approach: | They propose a plug-and-play framework for video-guided machine translation with multimodal large language models. |
| Outcome: | The proposed framework improves performance of MLLMs while reducing computational cost. |
On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | Modern unsupervised machine translation systems reach reasonable translation quality under clean and controlled data conditions. |
| Approach: | They compare unsupervised and supervised machine translation systems of similar quality . they combine the benefits of both methods into a single system . |
| Outcome: | The proposed system improves adequacy and fluency as measured by human evaluators. |
Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Multimodal machine translation (MMT) aims to improve translation quality by incorporating information from other modalities, such as vision. |
| Approach: | They propose a framework for multimodal machine translation that utilizes large-scale non-triple data and a multimodal translation dataset. |
| Outcome: | The proposed method can significantly improve translation performance with more non-triple data. |
Parameter-Efficient Korean Character-Level Language Modeling (2023.eacl-main)
Copied to clipboard
| Challenge: | Character-level language modeling has been shown to perform well on highly agglutinative or morphologically rich languages while using only a small fraction of the parameters required by (sub)word models. |
| Approach: | They propose a “three-hot” embedding and decoding scheme that exploits the decomposability of Korean characters to model at the syllable level but using only jamo-level representations. |
| Outcome: | The proposed model reduces the embedding parameters by 99.6% and does not lose translation quality compared to the baseline model. |
Mitigating Hallucinated Translations in Large Language Models with Hallucination-focused Preference Optimization (2025.naacl-long)
Copied to clipboard
| Challenge: | Machine Translation (MT) systems based on fine-tuned large language models (LLMs) are at a higher risk of generating hallucinations, which can severely undermine user’s trust and safety. |
| Approach: | They propose a method that intrinsically learns to mitigate hallucinations during the model training phase. |
| Outcome: | The proposed method reduces hallucinations by 89% on an average across three unseen target languages while preserving translation quality. |
Generating Diverse Translations with Sentence Codes (P19-1)
Copied to clipboard
| Challenge: | Existing methods to generate diverse translations use different sentence structures . Xu et al., 2018: generating multiple valid translations with high diversity is difficult . |
| Approach: | They propose to use sentence codes to condition the sentence generation to obtain diverse translations . they propose to sample multiple candidates, each of which conditioned on a unique code . |
| Outcome: | The proposed method generates paraphrase translations with drastically different structures . the proposed method can be easily adopted to existing translation systems . |
Non-Autoregressive Neural Machine Translation: A Call for Clarity (2022.emnlp-main)
Copied to clipboard
| Challenge: | Non-autoregressive translation models require a single forward pass to generate the output sequence instead of iteratively producing each predicted token. |
| Approach: | They propose to use a single forward pass to generate the output sequence instead of iteratively producing each predicted token. |
| Outcome: | The proposed models improve translation quality and speed under third-party testing environments. |
Measuring and Mitigating Name Biases in Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Neural machine translation systems exhibit problematic biases, such as stereotypical gender bias in occupation terms. |
| Approach: | They propose a method to reduce biases in person name translations by randomly switching entities during translation. |
| Outcome: | The proposed method eliminates the problem without any effect on translation quality. |
Why don’t people use character-level machine translation? (2022.findings-acl)
Copied to clipboard
| Challenge: | despite evidence character-level systems are comparable with subword systems, they are rarely used in competitive setups in machine translation competitions. |
| Approach: | They propose a two-step decoder architecture that does not suffer from a slow-down due to the length of character sequences. |
| Outcome: | The proposed character-level MT systems show better domain robustness and better morphological generalization . the proposed decoder architecture shows no slow-down due to the length of character sequences . |
Beyond Sentence-Level End-to-End Speech Translation: Context Helps (2021.acl-long)
Copied to clipboard
| Challenge: | Document-level contextual information has shown benefits to text-based machine translation, but whether and how it helps end-to-end speech translation is still under-studied. |
| Approach: | They propose a concatenation-based ST model with adaptive feature selection for computational efficiency. |
| Outcome: | The proposed model improves translation quality and robustness to (artificial) audio segmentation errors. |
Towards Reasonably-Sized Character-Level Transformer NMT by Finetuning Subword Systems (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to train character-level models require very deep architectures that are difficult and slow to train. |
| Approach: | They propose to fine tune a Transformer token-based model to get a model without token segmentation. |
| Outcome: | The proposed model improves translation quality and robustness to noise while requiring less token segmentation. |
Confidence-Aware Scheduled Sampling for Neural Machine Translation (2021.findings-acl)
Copied to clipboard
| Challenge: | Neural machine translation models are trained to maximize the likelihood of the next token given previous golden tokens as inputs, but at the inference stage, golden token is unavailable. |
| Approach: | They propose a scheduled sampling method that randomly replaces groundtruth tokens with predicted ones during training, ignoring real-time model competence. |
| Outcome: | The proposed method outperforms the Transformer and vanilla scheduled sampling on large-scale translations. |
Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have advanced machine translation (MT) a meta-evaluation dataset focused on non-literal translations is lacking . experimental results show the inaccuracies of traditional MT metrics and the limitations of LLM-as-a-Judge. |
| Approach: | They propose a meta-evaluation framework that leverages sub-agents to evaluate machine translation metrics. |
| Outcome: | The proposed framework improves on the knowledge cutoff and score inconsistency problem. |
Attribute-Controlled Translation with Preference Optimization (2026.findings-eacl)
Copied to clipboard
| Challenge: | Attribute-controlled translation (ACT) is a natural language processing task that produces translations that satisfy specific constraints on linguistic and stylistic attributes. |
| Approach: | They propose to leverage the contrastive nature of ACT tasks with preference optimization . they also propose to exploit knowledge distillation with synthetically-generated training samples . |
| Outcome: | The proposed approach improves attribute matching and translation quality in small-medium size models. |
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing pre-training methods are not effective for machine translation tasks. |
| Approach: | They propose a method to pre-train a universal multilingual neural machine translation model . they use random aligned substitution technique to bring words and phrases with similar meanings closer in the representation space. |
| Outcome: | The proposed approach improves translation quality on low, medium, rich resource languages. |
Towards Enhancing Faithfulness for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has achieved great success due to the ability to generate high-quality sentences. |
| Approach: | They propose a training strategy with a multi-task learning paradigm to build a faithfulness enhanced NMT model. |
| Outcome: | The proposed model can generate high-quality sentences that are very close to natural language. |
Streaming Models for Joint Speech Recognition and Translation (2021.eacl-main)
Copied to clipboard
| Challenge: | Using end-to-end models for speech translation has become a focus of the ST community . cascaded models have the advantage of including automatic speech recognition output . |
| Approach: | They propose a model that condenses sound waves into translated text and integrates automatic speech recognition outputs into the models. |
| Outcome: | The proposed model is statistically similar to cascading models, but has half the number of parameters. |
Steering Large Language Models for Machine Translation Personalization (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent advances in interpretability research have highlighted the effectiveness of steering methods for MT personalization. |
| Approach: | They examine steering strategies for personalizing automatic translations when few examples are available. |
| Outcome: | The proposed steering methods yield higher inference-time computational efficiency than prompting approaches. |
TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement (2025.findings-naacl)
Copied to clipboard
Zhaopeng Feng, Yan Zhang, Hao Li, Bei Wu, Jiayu Liao, Wenqiang Liu, Jun Lang, Yang Feng, Jian Wu, Zuozhu Liu
| Challenge: | Large Language Models (LLMs) have achieved impressive results in Machine Translation (MT). human evaluations reveal that LLM-generated translations still contain various errors. |
| Approach: | They propose a LLM-based self-refinement framework that feeds error information back into LLMs to facilitate self-finement, leading to enhanced translation quality. |
| Outcome: | The proposed framework outperforms internal refinement and feedback methods while ensuring a robust translation quality baseline. |
On Romanization for Model Transfer Between Scripts in Neural Machine Translation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Using romanization to improve low-resource machine translation is not always the best strategy. |
| Approach: | They propose to use romanization to improve transfer between languages with different scripts . they compare two romanization tools and find that they exhibit different degrees of information loss, which affects translation quality. |
| Outcome: | The proposed method improves transfer between languages with different scripts while entails information loss. |
Robustness of Multi-Source MT to Transcription Errors (2023.findings-acl)
Copied to clipboard
| Challenge: | In multilingual settings, the same content may be available in various languages via simultaneous interpreting, dubbing or subtitling. |
| Approach: | They hypothesize that leveraging multiple sources will improve translation quality if the sources complement one another in terms of correct information they contain. |
| Outcome: | The proposed method is robust to speech recognition errors on a 10-hour ESIC corpus. |
Sentence Level Human Translation Quality Estimation with Attention-based Neural Networks (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for assessing translation quality rely on manual features and external knowledge. |
| Approach: | They propose to use a neural model without feature engineering to detect which parts in sentence pairs are most relevant for assessing quality. |
| Outcome: | The proposed model outperforms feature-based methods on a large human annotated dataset. |
Gaussian Multi-head Attention for Simultaneous Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for siMT do not explicitly model the alignment to perform the control. |
| Approach: | They propose to model alignment and translation in a unified manner by Gaussian Multi-head Attention (GMA) they propose to integrate alignment-related priors into the translation model to determine final attention. |
| Outcome: | The proposed method outperforms strong baselines on trade-off between translation and latency. |
Learning Translations via Images with a Massively Multilingual Image Dataset (P18-1)
Copied to clipboard
| Challenge: | Existing datasets for learning translations of words are limited to a few high-resource languages and unrealistically easy settings. |
| Approach: | They propose a large-scale multilingual corpus of images labeled with the word they represent to facilitate translation research. |
| Outcome: | The proposed method improves on an unsupervised technique that has been limited to a few languages and unrealistic settings. |
Measuring and Improving Faithfulness of Attention in Neural Machine Translation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing evidence for faithfulness of neural machine translation models is lacking. |
| Approach: | They propose a novel objective that rewards faithful behaviour by the model through probability divergence and a differentiable objective that can increase faithfulness without reducing the translation quality. |
| Outcome: | The proposed objective increases faithfulness without reducing translation quality and can even improve translation quality in some cases. |
Progressive Multi-Granularity Training for Non-Autoregressive Translation (2021.findings-acl)
Copied to clipboard
| Challenge: | Non-autoregressive translation models are weak at learning high-mode knowledge, argues a new study . despite the improved learning difficulty, there are still complicated word orders and structures in the synthetic sentences, making the NAT performance sub-optimal. |
| Approach: | They propose to train non-autoregressive translation models to learn fine-grained lower-mode knowledge . they break down sentence-level examples into three types and increase granularities . |
| Outcome: | The proposed method improves phrase translation accuracy and model reordering ability against strong NAT baselines. |
On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that PT and BT are nicely complementary to each other. |
| Approach: | They introduce two probing tasks for PT and BT respectively and investigate their complementarity. |
| Outcome: | The proposed methods establish state-of-the-art on the WMT16 English-Romanian and English-Russian benchmarks. |
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent studies on multilingual representations focus on whether there is an emergence of language-independent representations or whether multilingual models partition their weights among different languages. |
| Approach: | They analyze encoder self-attention and encoder-decoder attention heads in a multilingual neural translation model. |
| Outcome: | The proposed model is based on a multilingual neural translation model with a language-independent representation. |
Isometric Neural Machine Translation using Phoneme Count Ratio Reward-based Reinforcement Learning (2024.findings-naacl)
Copied to clipboard
| Challenge: | Traditional Automatic Video Dubbing (AVD) pipelines use isometric-NMT algorithms to regulate the length of the output text. |
| Approach: | They propose an isometric-NMT system that regulates the length of the output text . they propose a phoneme Count Compliance score to measure length compliance . |
| Outcome: | The proposed approach improves phoneme count compliance scores by 36% compared to state-of-the-art models in English-Hindi language pairs. |
Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation (2020.acl-main)
Copied to clipboard
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu
| Challenge: | Existing multilingual NMT approaches do not utilize the abundance of monolingual data, especially in low-resource languages. |
| Approach: | They propose to combine monolingual data with self-supervision to pre-train translation models and fine-tune on small amounts of supervised data. |
| Outcome: | The proposed approach improves translation quality of low-resource languages and zero-shot translation quality. |
On The Evaluation of Machine Translation Systems Trained With Back-Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Back-translation is a data augmentation technique that can be used to improve neural machine translation systems. |
| Approach: | They propose to combine back-translation with a language model score to measure fluency. |
| Outcome: | The proposed method improves translation quality of natural text and translationese according to professional translators. |
Simultaneous Translation Policies: From Fixed to Adaptive (2020.acl-main)
Copied to clipboard
| Challenge: | Adaptive policies can balance translation quality and latency based on context information . previous methods on obtaining adaptive policies rely on complicated training process . |
| Approach: | They propose to obtain adaptive policies by a simple heuristic composition of fixed policies . they propose to use a heurism to obtain policies that can outperform fixed ones . |
| Outcome: | Experiments on Chinese -> English and German -> english show that adaptive policies outperform fixed policies by up to 4 BLEU points for the same latency. |
Multilingual Neural Machine Translation with Task-Specific Attention (C18-1)
Copied to clipboard
| Challenge: | Multilingual machine translation is a task of building a system capable of translating between multiple source and target languages. |
| Approach: | They propose task-specific attention models to retain parameter sharing generalization . they observe improved translation quality even in low-resource zero-shot directions . |
| Outcome: | The proposed model retains parameter sharing generalization while allowing language-specific specialization . it improves translation quality even in low-resource zero-shot translation directions . |
Guiding Large Language Models to Post-Edit Machine Translation with Error Annotations (2024.findings-naacl)
Copied to clipboard
| Challenge: | supervised systems have not replaced dedicated supervised models for machine translation tasks. |
| Approach: | They propose to guide LLMs to post-edit MT with feedback from MQM annotations . they then fine-tune the LLM to improve its ability to exploit the feedback . |
| Outcome: | The proposed model improves TER, BLEU and COMET scores on Chinese-English, English-German and English-Russian data. |
Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Knowledge distillation (KD) is commonly used to construct synthetic data for training non-autoregressive translation models. |
| Approach: | They propose to use knowledge distillation to generate training data for non-autoregressive translation models by leveraging pretraining. |
| Outcome: | The proposed approach achieves 28.2 and 33.9 BLEU points on the WMT14 English-German and WMT16 Romanian-English datasets. |
Self-training Reduces Flicker in Retranslation-based Simultaneous Translation (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to reduce flicker in simultaneous translation have increased the latency through masking and specialised inference, thus losing the simplicity of the approach. |
| Approach: | They propose to train a machine translation system to reduce flicker by controlling monotonicity and biased beam search to achieve the same flicker-latency tradeoff. |
| Outcome: | The proposed approach reduces flicker by controlling monotonicity while maintaining similar translation quality to the original. |
Visual Cues and Error Correction for Translation Robustness (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing robustness techniques fail when faced with unseen types of noise and their performance degrades on clean texts. |
| Approach: | They propose visual context to improve translation robustness for noisy texts . they also propose an error correction training regime that can be used as an auxiliary task . |
| Outcome: | The proposed training regime improves translation robustness on noisy texts while maintaining translation quality on clean texts. |
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on multimodality in simultaneous machine translation have highlighted the challenges for the agent to maintain good translation quality while learning an optimal translation path. |
| Approach: | They propose a multimodal approach to simultaneous machine translation using reinforcement learning with strategies to integrate visual and textual information in both the agent and the environment. |
| Outcome: | The proposed multimodal approach improves translation quality while keeping latency low while providing visual cues. |
Anticipating Future with Large Language Model for Simultaneous Machine Translation (2025.naacl-long)
Copied to clipboard
Siqi Ouyang, Oleksii Hrinchuk, Zhehuai Chen, Vitaly Lavrukhin, Jagadeesh Balam, Lei Li, Boris Ginsburg
| Challenge: | Existing methods only use the partial utterance that has already arrived at the input and the generated hypothesis. |
| Approach: | They propose to use a large language model to predict future source words and opportunistically translate without introducing too much risk. |
| Outcome: | The proposed method outperforms baselines on four language directions and achieves the best translation quality-latency trade-off by up to 5 BLEU points at the same latency. |
Reference Network for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) generates translations in isolation, resulting in translation inconsistency and ambiguity. |
| Approach: | They propose to incorporate referring process into translation decoding of NMT by using local coordinates coding to obtain global context vectors containing monolingual and bilingual contextual information. |
| Outcome: | The proposed model improves translation quality with lightweight computation cost on Chinese-English and English-German translation tasks. |
Aligning Translation-Specific Understanding to General Understanding in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language models (LLMs) have remarkable abilities in understanding complex texts . however, understanding misalignment leads to LLMs mistakenly translating complex concepts . |
| Approach: | They propose a translation process that aligns the translation-specific understanding with the general understanding to improve translation quality and reduce translation literalness. |
| Outcome: | The proposed translation process improves translation quality and reduces translation literalness by -25% -51%. |
Robust Neural Machine Translation with Joint Textual and Phonetic Embedding (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation models are sensitive to noises in input sentences . one special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations. |
| Approach: | They propose to embed phonetic and textual information into neural machine translation datasets to improve robustness to homophone noises. |
| Outcome: | The proposed method improves the robustness of neural machine translation to homophone noises on clean test sets. |
Using Bilingual Patents for Translation Training (2020.coling-main)
Copied to clipboard
| Challenge: | While bilingual corpora have been instrumental for machine translation, their utility for training translators has been understudied. |
| Approach: | They propose to use bilingual corpora to train translators in the technical domain. |
| Outcome: | The proposed method improves translation quality of technical terms by concordance with bilingual examples in the in-domain corpus than with general-domain bilingual corpus. |
Divide and Rule: Effective Pre-Training for Context-Aware Multi-Encoder Translation Models (2022.acl-long)
Copied to clipboard
| Challenge: | Multi-encoder models aim to improve translation quality by encoding document-level contextual information alongside the current sentence. |
| Approach: | They propose to pre-train contextual parameters over split sentence pairs to improve contextual encoding . they propose four different splitting methods to improve learning of contextual parameters . |
| Outcome: | The proposed model improves learning of contextual parameters, both in low and high resource settings. |
Investigating the Influence of Bilingual MWU on Trainee Translation Quality (L18-1)
Copied to clipboard
| Challenge: | a method for automatic extraction of bilingual multiword units (BMWUs) from a parallel corpus has been shown to be useful for estimating human translation quality. |
| Approach: | They applied a method for automatic extraction of bilingual multiword units from a parallel corpus in order to investigate their contribution to translation quality in terms of adequacy and fluency. |
| Outcome: | The method is based on generalized additive modelling and it shows that normalized BMWU ratios can be useful for estimating human translation quality. |
How to Split: the Effect of Word Segmentation on Gender Bias in Speech Translation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for subword splitting penalize the representation of feminine linguistic markings. |
| Approach: | They propose a method that preserves subword splitting while leveraging character-based segmentation to properly translate gender. |
| Outcome: | The proposed approach preserves BPE overall translation quality while leveraging the higher ability of character-based segmentation to properly translate gender. |
Non-autoregressive Streaming Transformer for Simultaneous Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Simultaneous machine translation models are trained to strike a balance between latency and translation quality. |
| Approach: | They propose a non-autoregressive streaming Transformer which generates blank tokens and decodes repetitive tokens to adjust its READ/WRITE strategy flexibly. |
| Outcome: | The proposed model outperforms previous strong autoregressive models on various benchmarks on siMT. |
Sing it, Narrate it: Quality Musical Lyrics Translation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing song translation approaches prioritize singability constraints at the expense of translation quality, which is crucial for musicals. |
| Approach: | They propose to automatically translate musical lyrics from English to Chinese to ensure high translation quality while adhering to singability requirements such as length and rhyme. |
| Outcome: | The proposed method improves both singability and translation quality over baseline methods and validates its effectiveness. |
Dual-teacher Knowledge Distillation for Low-frequency Word Translation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Neural machine translation models are trained on parallel corpora with unbalanced word frequency distribution, resulting in high-frequency words being ignored. |
| Approach: | They propose to employ a low-frequency teacher model that excels in translating low- frequency words to guide the learning of the student model. |
| Outcome: | The proposed method achieves +0.64 BLEU improvements over the state-of-the-art method on the low-frequency translation task while maintaining the translation quality of high-frequency words. |
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)
Copied to clipboard
Zhiwei Cao, Baosong Yang, Huan Lin, Suhang Wu, Xiangpeng Wei, Dayiheng Liu, Jun Xie, Min Zhang, Jinsong Su
| Challenge: | Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains. |
| Approach: | They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore. |
| Outcome: | The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore. |
Structural Supervision for Word Alignment and Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge on syntactic structure neglects the rich structural information from target tokens and the structural similarity between the source and target sentences. |
| Approach: | They propose to incorporate syntactic structure of both source and target tokens into the encoder-decoder framework, tightly correlating the internal logic of word alignment and machine translation for multi-task learning. |
| Outcome: | The proposed method outperforms baselines on four publicly available language pairs and consistently outperformed baselines in alignment accuracy and translation quality. |
Probing Multi-modal Machine Translation with Pre-trained Language Model (2021.findings-acl)
Copied to clipboard
| Challenge: | Multi-modal machine translation (MMT) aimed at using images to help disambiguate the target during translation but recent studies showed that visual features are either negligible or incremental. |
| Approach: | They propose to incorporate a visual language model on the source side to improve multi-modal translation quality significantly. |
| Outcome: | The proposed model improves the translation quality significantly on the multi-modal dataset. |
Translatotron-V(ison): An End-to-End Model for In-Image Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | In-image machine translation (IIMT) aims to translate an image containing texts in source language into an image with translations in target language. |
| Approach: | They propose an end-to-end IIMT model with four modules that translate images . they propose a two-stage training framework to assist the model in learning alignment across languages . |
| Outcome: | The proposed model outperforms cascaded models with only 70.9% of parameters and is highly accurate. |
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task (2021.acl-long)
Copied to clipboard
| Challenge: | Pretraining and multitask learning are widely used to improve the speech translation performance. |
| Approach: | They propose to train a speech translation model along with an auxiliary text translation task. |
| Outcome: | The proposed method improves translation quality by more than 2 BLEU over a strong baseline and achieves state-of-the-art results on the MuST-C English-German, English-French and English-Spanish language pairs. |
Understanding and Improving the Robustness of Terminology Constraints in Neural Machine Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing terminology constraint test sets are blind to this issue due to oversimplified settings . PH methods retain high constraint accuracy but lower translation quality . |
| Approach: | They propose a method that replaces terminology terms with ordered labels . placeholder methods are better at retaining high constraint accuracy but lower translation quality . |
| Outcome: | The proposed method achieves high accuracy and translation quality regardless of the number or length of constraints. |
Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focus on how to integrate multiple types of knowledge into NMT models . |
| Approach: | They propose a framework that integrates multiple types of knowledge into NMT models . they use multiple types as prefix-prompts of input for the encoder and decoder . |
| Outcome: | The proposed framework outperforms baselines on English-Chinese and English-German translation. |
Getting Gender Right in Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | linguistics studies show that the language used by males and females differs in terms of style and syntax. |
| Approach: | They integrate gender information into NMT systems to improve translation quality for multiple language pairs by incorporating gender information to a large dataset. |
| Outcome: | The proposed system significantly improves translation quality for some language pairs. |
End-to-End Non-Autoregressive Neural Machine Translation with Connectionist Temporal Classification (D18-1)
Copied to clipboard
| Challenge: | Autoregressive decoding is the only part of sequence-to-sequence models that prevents massive parallelization at inference time. |
| Approach: | They propose a non-autoregressive architecture based on connectionist temporal classification . they conduct experiments on the WMT English-Romanian and English-German datasets . |
| Outcome: | The proposed model achieves a significant speedup over autoregressive models . the model can be trained end-to-end and maintains translation quality comparable to other models compared to autoregression models based on connectionist temporal classification . |
The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilities (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that fine-tuning large language models improves their translations, but it is unclear what is the impact on desirable LLM behaviors that are not present in neural machine translation models. |
| Approach: | They perform an extensive translation evaluation on LLaMA and Falcon models with model size ranging from 7 billion up to 65 billion parameters. |
| Outcome: | The proposed model produces less literal translations after fine-tuning on parallel data. |
Breaking the Beam Search Curse: A Study of (Re-)Scoring Methods and Stopping Criteria for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Beam search is widely used in neural machine translation, but beam sizes larger than 5 hurt translation quality. |
| Approach: | They propose to use beam search to improve translation quality by using hyperparameter-free methods that outperform the widely-used heuristic of length normalization by +2.0 BLEU. |
| Outcome: | The proposed methods outperform the widely-used heuristic on Chinese-to-English translation and achieve the best results among all methods. |
NeoAMT: Neologism-Aware Agentic Machine Translation with Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Neologism-aware machine translation aims to translate source sentences containing neologismes into target languages. |
| Approach: | They propose an agentic framework for neologism-aware machine translation equipped with a Wiktionary-based search toolkit. |
| Outcome: | The proposed framework is based on a Wiktionary-based search toolkit and a dedicated dataset for neologism-aware machine translation. |
Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to simultaneous speech-to-speech translation accumulate more and more latencies in later sentences when the speaker talks faster. |
| Approach: | They propose a method which generates more fluent target speech latency than the baseline . they propose to use self-adaptive translation to adjust the length of translations to accommodate different source speech rates. |
| Outcome: | Xiong et al., 2019) show that the proposed method generates more fluent target speech latency than baseline . authors say it provides more natural communication process than speech-to-text translation . xiong and colleagues say the proposed technique is more efficient than current approaches . |
DART: Disambiguation-Aware Reasoning for Video-guided Machine Translation (2026.acl-long)
Copied to clipboard
| Challenge: | Video-guided Machine Translation (VMT) uses short video clips to enhance translation quality, but many samples are text-sufficient. |
| Approach: | They propose a framework that integrates multimodal large language models’ multimodal reasoning into video-guided machine translation by using a pipeline for constructing training data based on multimodal relevance to translation. |
| Outcome: | The proposed framework improves multimodal information utilization in video-guided machine translation, yielding gains in translation quality and computational efficiency. |
Remedy-R: Generative Reasoning for Machine Translation Evaluation without Error Annotations (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent MT metrics like xCOMET, Met-ricX, and Remedy have strong correlations with human preferences, but they are black boxes, revealing little insight into why a translation is good or bad. |
| Approach: | They propose a reasoning-driven generative MT metric trained with reinforcement learning from pairwise translation preferences without requiring error-span annotations or distillation from closed LLMs. |
| Outcome: | The proposed reasoning-driven generative MT metric produces step-by-step analyses of accuracy, fluency, and completeness, enabling more interpretable assessments. |
Towards Inducing Long-Context Abilities in Multilingual Neural Machine Translation Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Neural Machine Translation models traditionally use Sinusoidal Positional Embeddings . retraining with newer methods like ROPE or ALIBI is computationally expensive . |
| Approach: | They propose to transition NMT models from Sinusoidal to Relative PEs without compromising performance. |
| Outcome: | The proposed approach outperforms models trained with Sinusoidal PEs on document-level benchmarks . the results show that parameter-efficient fine-tuning can facilitate the transition . |
Graph-Assisted Culturally Adaptable Idiomatic Translation for Indic languages (2025.findings-acl)
Copied to clipboard
| Challenge: | a single source idiom can have multiple target-language equivalents depending on cultural references and contextual variations. |
| Approach: | They propose an adaptive graph neural network-based method that learns intricate mappings between idiomatic expressions and generalizes to both seen and unseen nodes during training. |
| Outcome: | The proposed method improves translation quality even in resource-constrained settings, facilitating improved idiomatic translation in smaller models. |
Hybrid-Regressive Paradigm for Accurate and Speed-Robust Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive translation (NAT) is less robust in decoding batch size and hardware settings than NAT. |
| Approach: | They propose a two-stage translation prototype that prompts a small number of AT predictions and fills in previously skipped tokens at once. |
| Outcome: | The proposed translation prototype achieves comparable translation quality with AT while having 1.5x faster inference speed regardless of batch size and device. |
word2word: A Collection of Bilingual Lexicons for 3,564 Language Pairs (2020.lrec-1)
Copied to clipboard
| Challenge: | Our dataset provides top-k word translations in 3,564 (directed) language pairs across 62 languages in OpenSubtitles2018. |
| Approach: | They propose a dataset and an open-source Python package for cross-lingual word translations extracted from sentence-level parallel corpora. |
| Outcome: | The proposed bilingual lexicons have high coverage and achieve competitive translation quality for several language pairs. |
Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs (2025.findings-naacl)
Copied to clipboard
Aarón Galiano-Jiménez, Juan Antonio Pérez-Ortiz, Felipe Sánchez-Martínez, Víctor M. Sánchez-Cartagena
| Challenge: | Existing multilingual pre-trained models for low-resource languages have outperformed those trained from scratch for low resources due to high hardware requirements. |
| Approach: | They propose to use beam search to decode the whole output distribution of the teacher to improve student learning. |
| Outcome: | The proposed methods improve student model performance and reduce gender bias amplification common to beam search based methods. |
A Query-Response Framework for Whole-Page Complex-Layout Document Image Translation with Relevant Regional Concentration (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for document image translation rely on the vanilla encoder-decoder paradigm . a novel dynamic aggregation mechanism is designed to enhance the text semantics in query features toward translation. |
| Approach: | They propose a Query-Response DIT framework that reformulates the DIT task into a parallel response/translation process of multiple queries. |
| Outcome: | The proposed framework improves translation quality on four translation directions on three benchmarks. |
Improving Low-Resource NMT through Relevance Based Linguistic Features Incorporation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies on incorporating arbitrary syntactic information into neural machine translation (NMT) are lacking. |
| Approach: | They propose to integrate linguistic knowledge at different levels into neural machine translation framework to improve translation quality for language pairs with extremely limited data. |
| Outcome: | The proposed methods improve translation quality for all tasks by 3.09 BLEU points . the proposed methods are based on two different approaches . |
The Two Shades of Dubbing in Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Dubbing has two shades; synchronisation constraints are applied only when the actor’s mouth is visible on screen, while the translation is unconstrained for off-screen dubbing. |
| Approach: | They annotate an existing dubbing corpus for this dichotomy and find that on-screen dubbing is more difficult for MT than off-screen. |
| Outcome: | The results show that on-screen dubbing is more difficult for MT than off-screen translation, and that synchronisation constraints dramatically decrease translation quality for off- screen dubbing. |
Unsupervised Extraction of Partial Translations for Neural Machine Translation (N19-1)
Copied to clipboard
| Challenge: | Neural machine translation systems usually require a large quantity of bilingual parallel data for training. |
| Approach: | They propose an algorithm for extracting from monolingual data what they call partial translations . partial translation is a pair of source and target sentences that contain sequences of tokens that are translations of each other. |
| Outcome: | The proposed algorithm extracts from monolingual data what we call partial translations . it takes only source and target monolingual datasets as input . |
Addressing word-order Divergence in Multilingual Neural Machine Translation for extremely Low Resource Languages (N19-1)
Copied to clipboard
| Challenge: | Existing studies show that transfer learning works best when the languages are related. |
| Approach: | They propose to pre-order assisting language sentences to match the word order of the source language and train the parent model. |
| Outcome: | The proposed model can improve translation quality in low-resource scenarios by pre-ordering the assisting language sentences to match the word order of the source language and training the parent model. |
Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data? (2024.acl-long)
Copied to clipboard
| Challenge: | Existing two-pass direct speech-to-speech translation models require parallel speech data to train, which is challenging to collect. |
| Approach: | They propose a two-pass direct speech-to-speech translation (S2ST) model that decomposes the task into speech- to-text translation (s2TT) and text-tospech (TTS) they propose 'composer' S2ST model that integrates pretrained S2TT and TTS models into a direct S2 ST model. |
| Outcome: | The proposed model integrates pretrained S2TT and TTS models into a direct S2ST model without parallel speech data. |
CA*: Addressing Evaluation Pitfalls in Computation-Aware Latency for Simultaneous Speech Translation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing metrics for Simultaneous speech translation (SimulST) are inaccurately measuring latency in unsegmented streaming settings. |
| Approach: | They propose to modify existing metrics to correctly measure computation-aware latency for SimulST systems, addressing limitations present in existing metrics. |
| Outcome: | The proposed model is based on a real-time, lowlatency scenario where the model starts generating the textual translation before the entire audio input is processed. |
Knowledge Graph Enhanced Neural Machine Translation via Multi-task Learning on Sub-entity Granularity (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to integrate knowledge graph (KG) with neural machine translation (NMT) have two problems: knowledge under-utilization and granularity mismatch. |
| Approach: | They propose a multi-task learning method on sub-entity granularity to combine machine translation and knowledge reasoning tasks. |
| Outcome: | The proposed method significantly outperforms baseline models on translation tasks and handling the entities. |
Konbitzul: an MWE-specific database for Spanish-Basque (L18-1)
Copied to clipboard
| Challenge: | Multiword Expressions (MWEs) are combinations of words which express a single meaning. |
| Approach: | They present an online database of verb+noun MWEs in Spanish and Basque. |
| Outcome: | The proposed database helps to identify occurrences of MWEs in multiple morphosyntactic variants and improve translation quality in rule-based MT. |
Domain Transfer based Data Augmentation for Neural Query Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Query translation (QT) is a critical factor in successful cross-lingual information retrieval (CLIR). |
| Approach: | They propose to extend query translation (QT) with a domain transfer procedure to revise synthetic candidates to search-aware examples. |
| Outcome: | The proposed method outperforms baselines and domain transfer methods on translation quality and retrieval accuracy. |
Multimodal Transformer for Multimodal Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to incorporate information from other modality, usually static images, are not considered relative to multimodal machine translation. |
| Approach: | They propose a multimodal self-attention method which learns the representation of images based on the text, which avoids encoding irrelevant information in images. |
| Outcome: | The proposed model outperforms previous studies and competitive baselines in terms of various metrics. |
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to simultaneous speech-to-text translation suffer from error propagation and extra latency. |
| Approach: | They propose a new paradigm for simultaneous speech-to-text translation using two separate decoders . they use multitask learning to jointly learn these two tasks with a shared encoder . |
| Outcome: | The proposed method achieves substantially better translation quality at similar levels of latency. |
Neighbors Are Not Strangers: Improving Non-Autoregressive Translation under Low-Frequency Lexical Constraints (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to lexically constrained neural machine translation suffer from high latency. |
| Approach: | They propose a plug-in algorithm for non-autoregressive translation for this problem . they propose ACT to familiarize the model with the source-side context of constraints . |
| Outcome: | The proposed model improves over the backbone constrained NAT model in constraint preservation and translation quality, especially for rare constraints. |
Open-Domain Sign Language Translation Learned from Online Video (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on sign language translation has focused mainly on data collected in controlled environments or domains, which limits its applicability to real-world settings. |
| Approach: | They propose to use sign search as a pretext task and fusion of mouthing and handshape features to improve sign language translation in real-world settings. |
| Outcome: | The proposed techniques produce consistent and large improvements over baseline models based on prior work. |
Extremely Low Bit Transformer Quantization for On-Device Neural Machine Translation (2020.findings-emnlp)
Copied to clipboard
Insoo Chung, Byeongwook Kim, Yoonjung Choi, Se Jung Kwon, Yongkweon Jeon, Baeseong Park, Sangha Kim, Dongsoo Lee
| Challenge: | Quantization is an effective technique to address heavy computation load and memory overhead during inference. |
| Approach: | They propose a low-bit quantization strategy to represent Transformer weights by an extremely low number of bits. |
| Outcome: | The proposed model achieves 11.8 smaller model size than baseline model, with less than -0.5 BLEU. |
An Empirical Study of In-context Learning in LLMs for Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies focus on optimizing translation quality, with limited attention to understanding specific aspects of ICL that influence the said quality. |
| Approach: | They conduct the first of its kind, exhaustive study of in-context learning for machine translation (MT) they establish that ICL is primarily example-driven and not instruction-driven . |
| Outcome: | The proposed model is based on examples and not instruction-driven learning. |
Text Style Transfer Back-Translation (2023.acl-long)
Copied to clipboard
Daimeng Wei, Zhanglin Wu, Hengchao Shang, Zongyao Li, Minghan Wang, Jiaxin Guo, Xiaoyu Chen, Zhengzhe Yu, Hao Yang
| Challenge: | Current methods require large amount of bilingual training data, which is challenging and sometimes impossible task. |
| Approach: | They propose a method to modify the style of inputs by modifying the source side of BT data. |
| Outcome: | The proposed method significantly improves translation quality against popular BT benchmarks on high-resource and low-resourced language pairs. |
Online Versus Offline NMT Quality: An In-depth Analysis on English-German and German-English (2020.coling-main)
Copied to clipboard
Maha Elbayad, Michael Ustaszewski, Emmanuelle Esperança-Rodier, Francis Brunet-Manquat, Jakob Verbeek, Laurent Besacier
| Challenge: | Existing studies compare offline and online neural machine translation architectures . we examine the impact of online decoding constraints on the translation quality . |
| Approach: | They evaluate offline and online neural machine translation architectures using human evaluations on English-German and German-English language pairs. |
| Outcome: | The proposed models are particularly sensitive to latency constraints and are well-suited for offline translation tasks. |
Rewriter-Evaluator Architecture for Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to improve neural machine translation models with multiple decoding passes lack proper policies to terminate multi-pass processes. |
| Approach: | They propose a novel architecture of Rewriter-Evaluator to terminate multi-pass decoding . they propose prioritized gradient descent to jointly and efficiently train rewriter and evaluator . |
| Outcome: | The proposed architecture significantly outperforms existing methods on three translation tasks and reduces performance gaps to oracle policies. |
Improving Language Model Integration for Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to integrate external language models into machine translation systems have been based on the assumption that the external model learns an implicit target-side language model at decoding time. |
| Approach: | They transfer this concept to the task of machine translation and compare it with the most prominent way of including additional monolingual data - namely back-translation. |
| Outcome: | The proposed approach outperforms the most prominent way of including additional monolingual data, namely back-translation. |
Modeling Bilingual Conversational Characteristics for Neural Chat Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Neural chat translation aims to translate bilingual conversational text due to its inherent characteristics such as role preference, dialogue coherence, and translation consistency. |
| Approach: | They propose to model the translation quality of conversational text by learning distributions of bilingual conversational characteristics. |
| Outcome: | The proposed approach outperforms baseline models and is widely available. |
Content-Equivalent Translated Parallel News Corpus and Extension of Domain Adaptation for NMT (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods to train NMT systems with noisy data are not sufficient . a recent increase in foreigners visiting Japan has created a significant information gap . |
| Approach: | They propose a Japanese-English parallel news corpus that is content-equivalent . they extend a domain-adaptation method to train NMT models with clean corpus . |
| Outcome: | The proposed corpus improves translation quality and is more effective than existing methods. |
Towards General Error Diagnosis via Behavioral Testing in Machine Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing behavioral testing approaches only evaluate translation quality without references, restricting diagnosis to specific types of errors. |
| Approach: | They propose a bilingual translation pair generation based behavior testing framework that auto-generates test cases and pseudo-references to facilitate general error diagnosis. |
| Outcome: | The proposed framework can provide comprehensive and accurate behavioral testing results for general error diagnosis on machine translation systems. |
Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Model (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to improve translation quality using human feedback have not been validated. |
| Approach: | They propose to use quality estimation to predict human preferences for feedback training . they propose to detect incorrect translations and assign a penalty term to the reward scores . |
| Outcome: | The proposed method outperforms systems using larger parallel corpora by a small amount of monolingual data. |
An Evaluation Benchmark for Testing the Word Sense Disambiguation Capabilities of Machine Translation Systems (2020.lrec-1)
Copied to clipboard
| Challenge: | Lexical ambiguity is one of the many challenging linguistic phenomena involved in translation, i.e., translating an ambiguous word with its correct sense. |
| Approach: | They propose to use training data to measure the sense distributions of a machine translation system to measure lexical ambiguity. |
| Outcome: | The proposed benchmark builds upon the multilingual sense inventory of BabelNet, the multilinguistic neural parsing pipeline TurkuNLP, and the OPUS collection of translated texts from the web. |
Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspective (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on extracting multi-granularity visual features for integration or designing model architectures for better message passing across various modalities. |
| Approach: | They propose to decompose the informative visual signals into two parts: source-specific information and target-specific info. |
| Outcome: | The proposed method can enhance the visual awareness of MMT models against strong baselines. |
JASS: Japanese-specific Sequence to Sequence Pre-training for Neural Machine Translation (2020.lrec-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) requires large parallel corpora for training robust and high quality models. |
| Approach: | They propose a Japanese-specific sequence to sequence pre-training alternative to MASS for NMT . they use Japanese as the source or target language to train their models . |
| Outcome: | The proposed approach can give competitive results over MASS and BRSS, and significantly surpass the individual methods. |
Semantically Consistent Data Augmentation for Neural Machine Translation via Conditional Masked Language Model (2022.coling-1)
Copied to clipboard
| Challenge: | Neural network models have a large number of parameters to train, but data augmentation is relatively under-explored in natural language processing. |
| Approach: | They propose a bi-directional conditional Masked Language Model (CMLM) that can be conditional on both left and right contexts and the label. |
| Outcome: | The proposed method achieves the best performance on four translation datasets and yields up to 1.90 BLEU points over the baseline. |
Non-Autoregressive Translation by Learning Target Categorical Codes (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive text generation models still fall behind in translation quality . authors propose a model that learns implicitly categorical codes as latent variables . |
| Approach: | They propose a non-autoregressive Transformer model that implicitly categorizes latent variables into decoding . they find it improves translation quality by introducing more informative decoder inputs . |
| Outcome: | The proposed model achieves comparable or better performance in machine translation tasks than strong baselines. |
Simplifying Neural Machine Translation with Addition-Subtraction Twin-Gated Recurrent Networks (D18-1)
Copied to clipboard
| Challenge: | Existing gated recurrent networks have a vanishing gradient, allowing for more matrix transformations and less transparent functions. |
| Approach: | They propose an additionsubtraction twin-gated recurrent network (ATR) to simplify neural machine translation. |
| Outcome: | The proposed system is more transparent than LSTM/GRU due to the simplification. |
Literary Machine Translation under the Magnifying Glass: Assessing the Quality of an NMT-Translated Detective Novel on Document Level (2020.lrec-1)
Copied to clipboard
| Challenge: | Several studies have demonstrated that translation quality has improved enormously since the emergence of neural machine translation systems. |
| Approach: | They performed a document-level evaluation of the raw NMT output of an entire novel and annotated it in two steps: first all fluency errors, then all accuracy errors. |
| Outcome: | The results show that translation quality has improved enormously since the emergence of neural machine translation systems. |
Handle with Care: A Case Study in Comparable Corpora Exploitation for Neural Machine Translation (2020.lrec-1)
Copied to clipboard
| Challenge: | Comparable corpora are an important source of potential parallel data, suitable for training data-driven machine translation systems. |
| Approach: | They present a case study on the exploitation of comparable corpora for machine translation. |
| Outcome: | The results show that filtering in terms of alignment thresholds and length-difference outliers has a significant impact on translation quality. |
Training Simultaneous Speech Translation with Robust and Random Wait-k-Tokens Strategy (2023.emnlp-main)
Copied to clipboard
| Challenge: | Simultaneous Speech Translation (SimulST) is a task focused on ensuring high-quality translation of speech in low-latency situations. |
| Approach: | They propose a token-level cross-modal alignment method to improve the translation of text to audio . they use audio transcription pairs to pre-train the encoder and a random wait-k-tokens strategy to optimize the task. |
| Outcome: | The proposed method achieves better trade-off between translation quality and latency. |
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation (2025.findings-acl)
Copied to clipboard
Yingfeng Luo, Tong Zheng, Yongyu Mu, Bei Li, Qinghong Zhang, Yongqi Gao, Ziqiang Xu, Peinan Feng, Xiaoqian Liu, Tong Xiao, JingBo Zhu
| Challenge: | Recent advances in machine translation have focused on a single pre-trained decoder . encoder-decoder architectures have received relatively little attention in NMT . |
| Approach: | They propose a method that leverages LLMs as MT encoders and pairs them with lightweight decoders to develop universal translation models. |
| Outcome: | The proposed method matches or surpasses baselines in terms of translation quality but achieves 75% reduction in memory footprint of the KV cache. |
Multilingual Data Filtering using Synthetic Data from Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that effective filters can be created by utilising Large Language Models to synthetically label data, which is then used to train smaller neural models for filtering purposes. |
| Approach: | They extend this approach to languages beyond English to train neural models for filtering purposes. |
| Outcome: | The proposed approach is effective at filtering parallel text for translation quality and filtering for domain specificity. |
Measuring and Increasing Context Usage in Context-Aware Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Recent work in neural machine translation has demonstrated the necessity and feasibility of using inter-sentential context, but it is often not clear how much they actually utilize it at translation time. |
| Approach: | They propose a conditional cross-mutual information metric to quantify usage of context by model architectures that can use it at translation time. |
| Outcome: | The proposed method increases context usage and improves translation quality according to BLEU and COMET metrics. |
Exploring Recombination for Efficient Decoding of Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) decoder captures features of entire prediction history . some partial hypotheses with different prefixes will be regarded differently no matter how similar they are . |
| Approach: | They propose a method that uses a n-gram suffix to adapt it to beam search decoding. |
| Outcome: | The proposed method can obtain similar translation quality with a smaller beam size, making it more efficient. |
Modeling Context With Linear Attention for Scalable Document-Level Translation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Document-level machine translation models lack quadratic complexity in the sequence length due to their attention layers. |
| Approach: | They evaluate a recent linear attention model with a sentential gate to promote a recency inductive bias and compare it to open-source document translation. |
| Outcome: | The proposed model significantly improves translation quality on IWSLT 2015 and OpenSubtitles 2018 with similar or better BLEU scores. |
CTQScorer: Combining Multiple Features for In-context Example Selection for Machine Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated the capability to perform on machine translation when the input is prompted with a few examples. |
| Approach: | They propose a regression model that combine features influencing example selection to maximize translation quality. |
| Outcome: | The proposed model outperforms random selection and strong single-factor baselines on multiple language pairs and language models. |
MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing research has focused on providing individual, well-defined types of context in translation, such as the surrounding text or discrete external variables like the speaker’s gender. |
| Approach: | They introduce a novel neural machine translation framework that interprets all context as text. |
| Outcome: | The proposed framework outperforms a baseline that matched the parameters and significantly outperformed it in English translation. |
Dub-S2ST: Textless Speech-to-Speech Translation for Seamless Dubbing (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing speech translation approaches often overlook the transfer of speech patterns, leading to mismatches with source speech and limiting their suitability for dubbing applications. |
| Approach: | They propose a diffusion-based speech-to-unit translation model with explicit duration control that enables time-aligned translation. |
| Outcome: | The proposed system preserves key characteristics such as duration, speaker identity, and speaking speed while maintaining key characteristics. |
Adapting Multilingual Models for Code-Mixed Translation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work has addressed the lack of gold standard code-mixed to pure language parallel data with data augmentation techniques. |
| Approach: | They propose a back-translation-based training scheme for code-mixed translation which eliminates dependence on external resources. |
| Outcome: | The proposed model beats previous work by up to +3.8 BLEU on code-mixed tasks. |
Self-Modifying State Modeling for Simultaneous Machine Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for simultaneous machine translation fail to optimize the policy . existing methods require building a decision path to learn the policy, but they cannot explore all potential paths . |
| Approach: | They propose a new training paradigm that uses a read/write policy to optimize the policy . existing methods usually require building a decision path to learn a suitable policy a user makes . |
| Outcome: | The proposed model outperforms strong baselines and allows offline models to acquire SiMT ability with fine-tuning. |
MLQE-PE: A Multilingual Quality Estimation and Post-Editing Dataset (2022.lrec-1)
Copied to clipboard
Marina Fomicheva, Shuo Sun, Erick Fonseca, Chrysoula Zerva, Frédéric Blain, Vishrav Chaudhary, Francisco Guzmán, Nina Lopatina, Lucia Specia, André F. T. Martins
| Challenge: | Existing datasets for machine translation quality estimation and post-editing have several shortcomings. |
| Approach: | They propose a dataset for machine translation quality estimation and automatic post-editing . they report the performance of baseline systems trained on the MLQE-PE dataset . |
| Outcome: | The proposed dataset contains human labels for up to 10,000 translations per language pair. |
VQA-Augmented Machine Translation with Cross-Modal Contrastive Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing multimodal machine translation methods often extract visual features using pre-trained models while learning text features from scratch, leading to representation imbalance. |
| Approach: | They propose a cross-modal VQA-augmented multimodal machine translation method . it aligns image-source text pairs and image-question text pairs through dual-text contrastive learning . |
| Outcome: | The proposed method outperforms state-of-the-art methods on multiple evaluation metrics. |
A Generative Framework for Simultaneous Machine Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches use a fixed number of source words to translate or learn dynamic policies for the number of sources by reinforcement learning. |
| Approach: | They propose a generative framework that uses a latent variable to model read or translate actions at every time step and integrates out to consider all possible translation policies. |
| Outcome: | The proposed framework achieves the best BLEU scores on benchmark datasets. |
Learning Adaptive Segmentation Policy for End-to-End Simultaneous Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods to perform simultaneous speech-to-text translation ignore contextual information and suffer from low translation quality. |
| Approach: | They propose an adaptive segmentation policy for simultaneous speech-to-text translation . it learns to segment the source streaming speech into meaningful units . |
| Outcome: | The proposed method achieves a good accuracy-latency trade-off over state-of-the-art methods on English-German and Chinese-English. |
CTC-based Non-autoregressive Textless Speech-to-Speech Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing direct speech-to-speech translation models require text supervision during training, which is not feasible for numerous unwritten languages. |
| Approach: | They propose a non-autoregressive (NAR) model that generates discrete units from the source speech and employs a unit-based vocoder to synthesize the target. |
| Outcome: | The proposed model achieves translation quality comparable to the autoregressive model while preserving up to 26.81 decoding speedup. |
Depth Growing for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation models with tens and even more than a hundred blocks have shown effectiveness in image recognition. |
| Approach: | They propose a two-stage approach with three specially designed components to construct deeper NMT models. |
| Outcome: | The proposed approach improves on WMT14 EnglishGerman and EnglishFrench translation tasks. |
CLAD-ST: Contrastive Learning with Adversarial Data for Robust Speech Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Cascaded approach is the most popular choice for speech translation, but lacks robustness when dealing with noisy inputs. |
| Approach: | They propose a cascaded approach that uses an automatic speech recognition model and a machine translation model to translate speech in one language to text in another language. |
| Outcome: | The proposed approach achieves significant gains of up to 3 BLEU scores in English-German and English-French speech translation without hurting the translation quality on clean text. |
Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Prior work treats all types of mismatches between source and target as noise . Consequently, it remains unclear how noisy parallel training samples impact NMT training. |
| Approach: | They propose a divergent-aware NMT framework that uses factors to help NMT recover from the degradation caused by naturally occurring divergences. |
| Outcome: | The proposed framework improves translation quality and model calibration on EN-FR tasks. |
In-context Examples Selection for Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Large-scale generative models can perform a wide range of NLP tasks using in-context learning. |
| Approach: | They aim to understand the properties of good in-context examples for machine translation in both in-domain and out-of-domain settings. |
| Outcome: | The proposed model outperforms a strong kNN-MT baseline in 2 out of 4 out-of-domain datasets. |
Imagination and Contemplation: A Balanced Framework for Semantic-Augmented Multimodal Machine Translation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Machine Translation (MMT) is effective in resolving linguistic ambiguities, but visual information often introduces redundancy or noise, potentially impairing translation quality. |
| Approach: | They propose a semantic-augmented framework that integrates "Imagination" and "Contemplation" they first generate synthetic images from source text and align them with authentic images via an optimal transport loss . |
| Outcome: | The proposed framework outperforms baselines on translation datasets with visually ambiguous or weakly correlated content. |
Generalized Data Augmentation for Low-Resource Translation (P19-1)
Copied to clipboard
| Challenge: | Low-resource language pairs with a lack of parallel data pose challenges for machine translation . data augmentation using monolingual data is an effective way to alleviate the problem . |
| Approach: | They propose a general framework for data augmentation for low-resource machine translation using monolingual data and a related high-resourced language. |
| Outcome: | The proposed method improves translation quality by 1.5 to 8 BLEU points under extreme low-resource settings compared to baselines. |
Training and Adapting Multilingual NMT for Less-resourced and Morphologically Rich Languages (L18-1)
Copied to clipboard
| Challenge: | Using multilingual and multi-way neural machine translation approaches is a major advantage . training NMT systems for individual language pairs takes significantly more time than training of SMT systems . |
| Approach: | They propose to employ multilingual and multi-way neural machine translation approaches for morphologically rich languages such as Estonian and Russian. |
| Outcome: | The proposed approach improves translation quality by +3.27 BLEU points over baseline models. |
Evaluation of Machine Translation Performance Across Multiple Genres and Languages (L18-1)
Copied to clipboard
| Challenge: | In this paper, we evaluate the impact of genre differences on machine translation (MT) for a diverse set of language pairs . BLEU score differences between genres can be large for all genres and all language pairs. |
| Approach: | They use multi-genre benchmarks to evaluate the impact of genre differences on machine translation (MT) they train and use genre classifiers to route test documents to the most appropriate genre systems . |
| Outcome: | The proposed system can improve translation quality for all genres and language pairs . |
Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translation (2025.acl-long)
Copied to clipboard
| Challenge: | Document Image Machine Translation (DIMT) faces generalization challenges due to limited training data and the complex interplay between visual and textual information. |
| Approach: | They propose a single-to-mix Modality alignment framework leveraging Multimodal Large Language Models (MLLMs) this framework aligns an imageonly encoder with multimodal representations of an MLLM pre-trained on large-scale document image datasets. |
| Outcome: | The proposed framework improves translation quality in cross-domain generalization and challenging document image scenarios. |
Should I Share this Translation? Evaluating Quality Feedback for User Reliance on Machine Translation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on the impact of feedback on human decision-making are limited as people are not equipped to assess the quality of AI predictions. |
| Approach: | They compare the quality of MT inputs and outputs with explicit and implicit feedbacks that directly give users an assessment of translation quality using error highlights and LLM explanations. |
| Outcome: | The proposed model improves decision accuracy and appropriate reliance by using error highlights and explanations, and by using backtranslation and question–answer tables. |
TRANS-ZERO: Self-Play Incentivizes Large Language Models for Multilingual Translation Without Parallel Data (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have reshaped machine translation, but multilingual MT still relies heavily on parallel data for supervised fine-tuning. |
| Approach: | They propose a framework that leverages only monolingual data and the intrinsic multilingual knowledge of Large Language Models (LLMs). |
| Outcome: | The proposed framework matches models trained on large-scale parallel data and excels in non-English translation directions. |
Don’t Rank, Combine! Combining Machine Translation Hypotheses Using Quality Estimation (2024.acl-long)
Copied to clipboard
| Challenge: | Neural machine translation models estimate probabilities of target sentences given source sentences, but these estimates may not align with human judgments. |
| Approach: | They propose a method that synthesizes translations using a quality estimation metric . they compare it with beam search and recent reranking techniques . |
| Outcome: | The proposed method outperforms other methods in large language models and multilingual translation models. |
Centroid-Based Efficient Minimum Bayes Risk Decoding (2024.findings-acl)
Copied to clipboard
| Challenge: | Minimum Bayes risk (MBR) decoding requires quadratic time since it computes the expected score between a translation hypothesis and all reference translations. |
| Approach: | They propose a centroid-based MBR decoding method that clusters the translations in the feature space and calculates the expected score using the centroids of each cluster. |
| Outcome: | The proposed method outperforms vanilla MBR decoding in translation quality by up to 0.5 COMET in the WMT’22 EnJa, EnDe, EnZh, and WMT'23 Enja translation tasks. |
LANDeRMT: Dectecting and Routing Language-Aware Neurons for Selectively Finetuning LLMs to Machine Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies have shown promising results in multilingual translation with limited bilingual supervision. |
| Approach: | They propose a Language-Aware Neuron Detecting and Routing framework that fine tunes LLMs to Machine Translation with diverse translation training data. |
| Outcome: | The proposed framework selectively finetunes LLMs to MT tasks with diverse translation training data. |
Data and Representation for Turkish Natural Language Inference (2020.emnlp-main)
Copied to clipboard
| Challenge: | Large annotated datasets in NLP are overwhelmingly in English . obtaining new annotation resources for each task in each language would be prohibitively expensive . |
| Approach: | They propose to use machine translation to translate large annotated datasets into Turkish . they find that in-language embeddings are essential and morphological parsing can be avoided . |
| Outcome: | The proposed model trains on human-translated evaluation sets. |
Document Graph for Neural Machine Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing document-level NMT methods fail to leverage contexts beyond a few set of previous sentences. |
| Approach: | They propose to represent a document as a graph that connects relevant contexts regardless of distances. |
| Outcome: | Experiments on IWSLT English–French, Chinese-English, WMT English–German and Opensubtitle English–Russian show that using document graphs can significantly improve translation quality. |
JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language Processing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing sign language datasets are limited and skewed towards high-income sign languages, mainly those from high-risk countries. |
| Approach: | They propose a large and highly multilingual dataset for sign language translation: JWSign. |
| Outcome: | The proposed dataset consists of 2,530 hours of Bible translations in 98 sign languages, featuring more than 1,500 individual signers. |
Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT (2021.emnlp-main)
Copied to clipboard
| Challenge: | Statistical MT decomposes the translation task into distinct components that are learned separately. |
| Approach: | They show that neural machine translation models acquire different competences over the course of training . previous work shows how to improve some of the competences in NMT by using lexical translation probabilities, phrase memories, alignment information. |
| Outcome: | The proposed model improves translation quality and word-by-word translation, while learning complex reordering patterns. |
Efficient Inference for Multilingual Neural Machine Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual NMT is an attractive solution for production, but to match bilingual quality, it comes at the cost of larger and slower models. |
| Approach: | They propose to use a shallow decoder with vocabulary filtering to speed up inference . they validate their findings with BLEU and chrF on 380 language pairs . |
| Outcome: | The proposed approach can be used in two 20-language multi-parallel settings. |
Accelerating Transformer Inference for Translation via Parallel Decoding (2023.acl-long)
Copied to clipboard
Andrea Santilli, Silvio Severino, Emilian Postolache, Valentino Maiorca, Michele Mancusi, Riccardo Marin, Emanuele Rodola
| Challenge: | Autoregressive decoding limits the efficiency of transformers for Machine Translation (MT) Existing methods to solve this problem are expensive and require changes to the model. |
| Approach: | They propose to reframe autoregressive decoding with a parallel formulation . they propose to speed up existing models without training or modifications while retaining translation quality. |
| Outcome: | The proposed model speeds up existing models without training or modifications while retaining translation quality. |
Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem (2020.acl-main)
Copied to clipboard
| Challenge: | Training data for NLP tasks often exhibits gender bias in that fewer sentences refer to women than to men. |
| Approach: | They propose a lattice-rescoring scheme which allows a trade-off between general translation quality and bias reduction during adaptation and inference time. |
| Outcome: | The proposed approach outperforms all systems evaluated on WinoMT with no degradation of general test set BLEU. |
PRIM: Towards Practical In-Image Multilingual Machine Translation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current research on in-image machine translation focuses on synthetic data with simple background, single font, fixed text position, and bilingual translation. |
| Approach: | They propose an end-to-end model to handle the challenge of practical conditions in PRIM . they annotate a real-world one-line text image with complex background, fonts, diverse text positions . |
| Outcome: | The proposed model improves translation quality and visual effect compared to other models. |
Domain adapted machine translation: What does catastrophic forgetting forget and why? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) models can be specialized by domain adaptation, often fine-tuning on a dataset of interest. |
| Approach: | They propose a novel approach to understanding catastrophic forgetting during NMT adaptation by investigating the relationship between the data and the in-domain vocabulary coverage. |
| Outcome: | The proposed model can be specialized by fine-tuning on a domain of interest, but can fail to achieve the predicted quality of the target domain. |
Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approach (2024.emnlp-main)
Copied to clipboard
| Challenge: | Incorrect translation of rare words can severely degrade the accuracy of ST models . |
| Approach: | They propose a retrieval-and-demonstration approach to enhance rare word translation accuracy in ST models by incorporating retrieved examples into ST models. |
| Outcome: | The proposed approach outperforms other modalities and exhibits higher robustness to unseen speakers. |
Document-Level Machine Translation with Large-Scale Public Parallel Corpora (2024.acl-long)
Copied to clipboard
| Challenge: | Document-level machine translation has inherent advantages over sentence-level translation due to additional information available to a model from document context. |
| Approach: | They propose to use document context to train context-aware models on these datasets and to use it to model document-level phenomena. |
| Outcome: | The proposed models improve translation quality and target document-level phenomena by incorporating contextual information from several preceding sentences. |
Physician Detection of Clinical Harm in Machine Translation: Quality Estimation Aids in Reliance and Backtranslation Identifies Critical Errors (2023.emnlp-main)
Copied to clipboard
| Challenge: | a major challenge in the practical use of Machine Translation (MT) is that users lack information on translation quality to make informed decisions about how to rely on outputs. |
| Approach: | They evaluate quality estimation feedback in vivo with a human study in a medical setting. |
| Outcome: | The proposed method improves appropriate reliance on MT, but backtranslation helps detect harmful errors. |
Low-resource Neural Machine Translation: Benchmarking State-of-the-art Transformer for Wolof<->French (2022.lrec-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) systems can translate between French (FR) 1 and Wolof (WO, ISO 639-3), a lowresource Niger-Congo language mainly spoken in Senegal (Gamble, 1950). |
| Approach: | They propose two neural machine translation systems based on sequence-to-sequence with attention and Transformer architectures to translate between French (FR) 1 and Wolof (WO, ISO 639-3). |
| Outcome: | The proposed models outperform the classic sequence-to-sequence model in all settings and are less sensitive to noise. |
SwiLTra-Bench: The Swiss Legal Translation Benchmark (2025.acl-long)
Copied to clipboard
Joel Niklaus, Jakob Merane, Luka Nenadic, Sina Ahmadi, Yingqiang Gao, Cyrill A. H. Chevalley, Claude Humbel, Christophe Gösken, Lorenzo Tanzi, Thomas Lüthi, Stefan Palombo, Spencer Poff, Boling Yang, Nan Wu, Matthew Guillod, Robin Mamié, Daniel Brunner, Julio Pereyra, Niko Grupen
| Challenge: | In Switzerland legal translation relies on legal experts who must be both legal experts and skilled translators—creating bottlenecks and impacting effective access to justice. |
| Approach: | They propose a multilingual benchmarking system that evaluates Swiss legal translation systems based on 180K aligned Swiss legal translator pairs . they show frontier models achieve superior translation performance across all document types while specialized translation systems excel specifically in laws but under-perform in headnotes. |
| Outcome: | The proposed model outperforms specialized models in laws but underperform in headnotes. |
Two Intermediate Translations Are Better Than One: Fine-tuning LLMs for Document-level Translation Refinement (2025.acl-long)
Copied to clipboard
| Challenge: | Recent research has shown that large language models (LLMs) can enhance translation quality through self-refinement. |
| Approach: | They propose to extend translation refinement from sentence-level to document-level by using document-to-document (Doc2Doc) translations. |
| Outcome: | The proposed method improves translation quality across ten translation tasks with LLaMA-3-8B-Instruct and Mistral-Nemo-Instru. |
Translation Memories as Baselines for Low-Resource Machine Translation (2022.lrec-1)
Copied to clipboard
| Challenge: | low-resource machine translation research often requires building baselines to benchmark progress in translation quality. |
| Approach: | They argue that using available text as a translation memory baseline is simple and effective . they say that if you have parallel text, you have a TM . |
| Outcome: | a new study shows that using available text as a translation memory baseline is simple and effective . low-resource machine translation is often of too low quality to use directly, the authors argue . |
An Empirical Study of Translation Hypothesis Ensembling with Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are becoming a one-fits-many solution, but they sometimes hallucinate or produce unreliable output. |
| Approach: | They propose to use several LLMs to ensemble translation hypotheses . they use instruction tuning, quality-based reranking, and minimum Bayes risk (MBR) decoding to improve translation quality. |
| Outcome: | The proposed method improves translation quality and instruction tuning improves the quality of the output. |
Addressing Posterior Collapse with Mutual Information for Improved Variational Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing variational inference models ignore their latent variables, a phenomenon called posterior collapse. |
| Approach: | They propose a new loss function for conditional variational autoencoders that counteracts posterior collapse by using a modified evidence lower bound objective and a factorized decoder. |
| Outcome: | The proposed model yields improved translation quality compared to existing models on WMT RoEn and DeEn. |
Human Raters Cannot Distinguish English Translations from Original English Texts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Prior work on translationese has identified common hallmarks of translationeses, but human accuracy of identifying translated text is understudied. |
| Approach: | They perform an evaluation of English original/translated texts to examine whether raters can classify texts as being original or translated English and the features that lead rater to judge text as being translated. |
| Outcome: | The results provide critical insight into work in translation studies and context for assessments of translationese classifiers. |
Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve beam search quality are inadequate in many ways . a new approximation to the beam search curse has been proposed . |
| Approach: | They propose an approximation to minimum Bayes risk decoding that would solve the beam search curse. |
| Outcome: | The proposed approximation has no equivalent to the beam search curse. |
Identifying Source Language Expressions for Pre-editing in Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | MT-mediated communication can benefit from pre-editing source language texts to ensure accurate transmission of intended meaning in the target language. |
| Approach: | They hypothesize that such expressions tend to be distinctive features of texts originally written in the source language rather than translations generated from the target language into the source languages. |
| Outcome: | The proposed method identified characteristic expressions of the native language despite the noise and inherent nuances of the task. |
Improving Machine Translation with Large Language Models: A Preliminary Study with Cooperative Decoding (2024.findings-acl)
Copied to clipboard
| Challenge: | Commercial machine translation engines are proficient in addressing the majority of translation requirements. |
| Approach: | They propose to combine NMT and MT-oriented LLMs to achieve superior translation quality by combining their strengths. |
| Outcome: | The proposed model can handle complex scenarios beyond the capability of NMT alone. |
Lexical Translation Inconsistency-Aware Document-Level Translation Repair (2023.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show document-level translation repair improves translation consistency but still suffers from lexical translation inconsistency due to the lack of inter-sentence context. |
| Approach: | They propose a document-level translation repair model to model translation inconsistency via automatic post-editing. |
| Outcome: | The proposed model improves translation quality and lexical consistency on document-level translation datasets. |
MuBench: Assessment of Multilingual Capabilities of Large Language Models Across 61 Languages (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation datasets lack cross-lingual alignment, leaving assessments of multilingual capabilities fragmented in both language and skill coverage. |
| Approach: | They propose to use multilingual consistency as a complementary metric to assess performance bottlenecks and guide model improvement. |
| Outcome: | The proposed model lacks cross-lingual alignment and language coverage gaps between state-of-the-art models. |
Neural Machine Translation Quality and Post-Editing Performance (2021.emnlp-main)
Copied to clipboard
| Challenge: | a recent study has shown that MT post-editing can reduce translation quality and speed . a large-scale study involving 30 professional translators examined the relationship between MT performance and post-edited outputs. |
| Approach: | They examine the relationship between MT performance and post-editing time and quality . they use neural MT of high quality to improve translation quality based on phrase-based MT . |
| Outcome: | The proposed model is not stable predictor of time or quality, the authors say . they find that better MT systems lead to fewer changes in the sentences . |
Can Automatic Metrics Assess High-Quality Translations? (2024.emnlp-main)
Copied to clipboard
| Challenge: | a recent human evaluation study found that translations produced by current MT systems achieve very high-quality scores when judged by humans on a direct assessment scale of 0 to 100. |
| Approach: | They stress-test the ability of current translation quality metrics to detect correct translations . they show that current metrics often over or underestimate translation quality . |
| Outcome: | The proposed method overestimates translation quality, the authors show . they show that current metrics often overestimate translation quality . |
Implicit Memory Transformer for Computationally Efficient Simultaneous Speech Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Simultaneous speech translation is an essential communication task difficult for humans whereby a translation is generated concurrently with oncoming speech inputs. |
| Approach: | They propose a transformer that implicitly retains memory through a new left context method, removing the need to explicitly represent memory with memory banks. |
| Outcome: | The proposed method provides a substantial speedup on the encoder forward pass with nearly identical translation quality when compared with the state-of-the-art approach that uses left context and memory banks. |
Code-Switching with Word Senses for Pretraining in Neural Machine Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Lexical ambiguity is a significant and pervasive challenge in Neural Machine Translation (NMT) many state-of-the-art (SOTA) NMT systems struggle to handle polysemous words . |
| Approach: | They propose an end-to-end approach for pretraining multilingual NMT models leveraging word sense-specific information from Knowledge Bases. |
| Outcome: | The proposed approach improves translation quality and scales to various data and resource-strapped scenarios. |
Finding the Optimal Byte-Pair Encoding Merge Operations for Neural Machine Translation in a Low-Resource Setting (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Using different byte pair encoder configurations, we can improve neural machine translation performance for low-resource languages. |
| Approach: | They investigate the impact of different Byte Pair Encoding configurations on neural machine translation performance for the Filipino-Cebuano language pair across various text domains. |
| Outcome: | The proposed methods show that smaller BPE configurations yield higher BLEU scores, indicating improved translation quality through finer tokenization granularity . larger BPE setups and the absence of BPE result in lower BLUE scores, suggesting a decline in translation quality due to coarser tokenisation. |
Outbound Translation User Interface Ptakopět: A Pilot Study (2020.lrec-1)
Copied to clipboard
| Challenge: | a task called outbound translation is not uncommon for Internet users to have to produce a text in a foreign language they have very little knowledge of and are unable to verify the translation quality. |
| Approach: | They propose an open-source modular system to inspect human interaction with machine translation systems enhanced with additional subsystems such as backward translation and quality estimation. |
| Outcome: | The proposed system is able to produce a text in a foreign language with minimal knowledge and is compared with MT systems of mid-range quality. |
LLM-based Translation Inference with Iterative Bilingual Understanding (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that the ability of large language models to generate contextual understanding of the sentence can degrade translation quality. |
| Approach: | They propose a method that generates contextual understanding for both source and target languages separately. |
| Outcome: | The proposed method outperforms strong comparison methods in multiple domains. |
Multilingual Holistic Bias: Extending Descriptors and Patterns to Unveil Demographic Biases in Languages at Scale (2023.emnlp-main)
Copied to clipboard
Marta Costa-jussà, Pierre Andrews, Eric Smith, Prangthip Hansanti, Christophe Ropers, Elahe Kalbassi, Cynthia Gao, Daniel Licht, Carleigh Wood
| Challenge: | Multilingual HolisticBias dataset includes 20,459 sentences in 50 languages . dataset is intended to uncover demographic imbalances and quantify mitigations . |
| Approach: | They propose a multilingual extension of the HolisticBias dataset . they use 118 demographic descriptors and three patterns to build multilingual sentences . |
| Outcome: | The proposed model improves translation quality when the source input only differs in gender . it also improves when the masculine human reference is used in the model . |
Mitigating the Language Mismatch and Repetition Issues in LLM-based Machine Translation via Model Editing (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have focused on using Large Language Models to improve translation quality . language mismatch and repetition are two of the main problems with LLMs . |
| Approach: | They propose to leverage model editing methods to reduce language mismatch and repetition . they propose to fetch intersections of locating results under different language settings . |
| Outcome: | The proposed methods reduce language mismatch and repetition ratios and enhance translation quality in most cases. |
xTower: A Multilingual LLM for Explaining and Correcting Translation Errors (2024.findings-emnlp)
Copied to clipboard
Marcos Treviso, Nuno Guerreiro, Sweta Agrawal, Ricardo Rei, José Pombal, Tania Vaz, Helena Wu, Beatriz Silva, Daan Stigt, Andre Martins
| Challenge: | Neural machine translation systems produce translations with errors and anomalies . understanding these errors can help improve the translation quality and user experience . |
| Approach: | They propose an open large language model (LLM) built on top of TowerBase to provide free-text explanations for translation errors in order to guide the generation of a corrected translation. |
| Outcome: | The proposed model improves translation quality and user experience by allowing translators to provide free-text explanations for errors and anomalies. |
How Far can 100 Samples Go? Unlocking Zero-Shot Translation with Tiny Multi-Parallel Data (2024.findings-acl)
Copied to clipboard
| Challenge: | a common solution to zero-shot translation is to add as many related translation directions as possible to the training corpus. |
| Approach: | They show that a small amount of multi-parallel data can achieve significant zero-shot improvements . they say that the resulting non-English performance is close to the complete translation upper bound . |
| Outcome: | The proposed model achieves +21.7 ChrF++ non-English translation improvements on EC30 dataset . the resulting non- English performance exceeds M2M100 by an average of 5.9 ChrF+ . |
EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing benchmarks often overlook intra-language variations, leaving speakers of non-standard dialects underserved. |
| Approach: | EnDive evaluates seven state-of-the-art large language models across tasks . human evaluations confirm high translation quality, with average scores of at least 6.02/7 . |
| Outcome: | EnDive evaluates state-of-the-art large language models across language understanding, reasoning, mathematics, logic tasks. |
Going Beyond Your Expectations in Latency Metrics for Simultaneous Speech Translation (2025.findings-acl)
Copied to clipboard
| Challenge: | Current evaluation practices in Simultaneous Speech Translation systems involve segmenting the input audio and its translations, calculating quality and latency metrics for each segment, and averaging the results. |
| Approach: | They propose to use the mean to estimate latency for Simultaneous Speech Translation systems to provide a better understanding of their results. |
| Outcome: | The proposed methods can provide a better understanding of SimulST systems’ latency. |
m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt (2024.lrec-main)
Copied to clipboard
Jian Yang, Hongcheng Guo, Yuwei Yin, Jiaqi Bai, Bing Wang, Jiaheng Liu, Xinnian Liang, LinZheng Chai, Liqun Yang, Zhoujun Li
| Challenge: | Existing multimodal neural machine translation models focus on bilingual translation, but experimental results show that they outperform the text-only baselines and multilingual multimodal methods by a large margin. |
| Approach: | They propose a framework to leverage the multimodal prompt to guide the Multimodal Multilingual Neural Machine Translation (m3P) this framework aligns the representations of different languages with the same meaning and generates the conditional vision-language memory for translation. |
| Outcome: | The proposed framework outperforms previous text-only baselines and multilingual multimodal methods by a large margin. |
Towards a Deep Understanding of Multilingual End-to-End Speech Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have witnessed the rapid development of end-to-end speech-totext translation (ST) which has demonstrated remarkable performance and outperformed conventional cascaded systems. |
| Approach: | They employ Singular Value Canonical Correlation Analysis to analyze representations learnt in a multilingual end-to-end speech translation model trained over 22 languages. |
| Outcome: | The proposed approach outperforms existing cascaded systems in predicting phonetic features and improves translation quality. |
Mitigating Translationese in Low-resource Languages: The Storyboard Approach (2024.lrec-main)
Copied to clipboard
Garry Kuwanto, Eno-Abasi E. Urua, Priscilla Amondi Amuok, Shamsuddeen Hassan Muhammad, Anuoluwapo Aremu, Verrah Otiende, Loice Emma Nanyanga, Teresiah W. Nyoike, Aniefon D. Akpan, Nsima Ab Udouboh, Idongesit Udeme Archibong, Idara Effiong Moses, Ifeoluwatayo A. Ige, Benjamin Ajibade, Olumide Benjamin Awokoya, Idris Abdulmumin, Saminu Mohammad Aliyu, Ruqayya Nasir Iro, Ibrahim Said Ahmad, Deontae Smith, Praise-EL Michaels, David Ifeoluwa Adelani, Derry Tanti Wijaya, Anietie Andy
| Challenge: | Low-resource languages often face challenges in acquiring high-quality language data due to the reliance on translation-based methods, which introduce the translationese effect. |
| Approach: | They propose a method that uses storyboards to elicit more fluent and natural sentences from native speakers without direct exposure to the source text. |
| Outcome: | The proposed method compared with traditional translation-based methods in terms of accuracy and fluency. |
Viewing Knowledge Transfer in Multilingual Machine Translation Through a Representational Lens (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies show that translation quality alone is not sufficient for measuring knowledge transfer in multilingual neural machine translation. |
| Approach: | They propose a method that measures representational similarities between languages to measure knowledge transfer. |
| Outcome: | The proposed method improves translation quality for low- and mid-resource languages across multiple datasets and models. |
In-Image Neural Machine Translation with Segmented Pixel Sequence-to-Sequence Model (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-Image Machine Translation (IIMT) aims to convert images containing texts from one language to another. |
| Approach: | They propose an end-to-end model instead of the traditional cascade methods which use optical character recognition followed by neural machine translation and text rendering. |
| Outcome: | The proposed model outperforms both cascade methods and current model in translation quality and robustness across various dimensions. |
MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale reinforcement learning (RL) methods have proven effective in enhancing the reasoning abilities of large language models. |
| Approach: | They propose an open-source adaptation of the R1-Zero RL framework for machine translation (MT) their code is available at https://github.com/fzp0424/MT-R1-zero. |
| Outcome: | The proposed framework surpasses towerinstruct-7B-v0.2 on the english-chinese benchmark by 1.26 points. |
Multi-Dimensional Machine Translation Evaluation: Model Evaluation and Resource for Korean (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on MT evaluation characterize quality of output with a single number . a recent advancement in MT technologies has enabled higher-quality, more nuanced translations . |
| Approach: | They propose a 1200-sentence MQM evaluation benchmark for English-Korean and a reference-free QE setup to evaluate the quality of the translations. |
| Outcome: | The proposed model outperforms the existing model in style and accuracy. |
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to streaming speech translation use an offline model with a wait-k policy . however, there is a mismatch problem with an offline inference model trained with complete utterances . |
| Approach: | They propose an offline streaming speech translation model with wait-k policy to support different latency requirements. |
| Outcome: | The proposed model achieves better trade-offs between translation quality and latency than baselines. |
NAIST-SIC-Aligned: An Aligned English-Japanese Simultaneous Interpretation Corpus (2024.lrec-main)
Copied to clipboard
| Challenge: | Simultaneous interpretation data is a task where an utterance is translated in real-time. |
| Approach: | They propose to use an automatically-aligned parallel English-Japanese SI dataset to make it suitable for model training. |
| Outcome: | The proposed model improves translation quality and latency over baselines. |
Parameter-Efficient Transfer Learning for End-to-end Speech Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to improve end-to-end speech translation are limited by the availability of labeled data. |
| Approach: | They propose a method which utilizes two lightweight adaptation techniques to modulate Attention and the Feed-Forward Network while preserving the capabilities of pre-trained models. |
| Outcome: | The proposed method outperforms baseline models and significantly improves performance in low-resource settings. |
Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering (2026.acl-long)
Copied to clipboard
Qiming Li, Xiaocheng Feng, Yixuan Ma, Ruihan Chen, Zihe Tong, Zekai Ye, Xiachong Feng, Libo Qin, Haoyu Ren, Kun Chen, Yunfei Lu, Dandan Tu, Bing Qin
| Challenge: | Existing approaches to enhance multilingual reasoning capabilities rely on costly multilingual training or employ prompting with external translation tools. |
| Approach: | They propose a training-free inference-time method to enhance multilingual reasoning capabilities via Representation Engineering without additional training data or tools. |
| Outcome: | The proposed method outperforms existing methods on four reasoning benchmarks in English and Thai and Swahili. |
Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that MT metrics return assessments as scalar scores that are difficult to interpret, posing a challenge to making informed design choices. |
| Approach: | They propose an interpretable evaluation framework that evaluates MT metrics in two scenarios that serve as proxies for filtering and translation re-ranking use cases. |
| Outcome: | The proposed framework offers clearer insights than correlation with human judgments. |
Can Large Language Models Translate Unseen Languages in Underrepresented Scripts? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive performance in machine translation, but struggle with unseen low-resource languages. |
| Approach: | They propose a benchmark to evaluate translation for Mongolian and Yi using linguistic resources. |
| Outcome: | The proposed model can translate Mongolian (in traditional script) and Yi with the help of linguistic resources, but is limited in its ability to handle these languages effectively. |
CaMMT: Benchmarking Culturally Aware Multimodal Machine Translation (2025.findings-emnlp)
Copied to clipboard
Emilio Villa-Cueva, Sholpan Bolatzhanova, Diana Turmakhan, Kareem Elzeky, Henok Biadglign Ademtew, Alham Fikri Aji, Vladimir Araujo, Israel Abebe Azime, Jinheon Baek, Frederico Belcavello, Fermin Cristobal, Jan Christian Blaise Cruz, Mary Dabre, Raj Dabre, Toqeer Ehsan, Naome A Etori, Fauzan Farooqui, Jiahui Geng, Guido Ivetta, Thanmay Jayakumar, Soyeong Jeong, Zheng Wei Lim, Aishik Mandal, Sofía Martinelli, Mihail Minkov Mihaylov, Daniil Orel, Aniket Pramanick, Sukannya Purkayastha, Israfel Salazar, Haiyue Song, Tiago Timponi Torrent, Debela Desalegn Yadeta, Injy Hamed, Atnafu Lambebo Tonja, Thamar Solorio
| Challenge: | a human-curated benchmark of over 5,800 triples of images is used to evaluate multimodal translation systems. |
| Approach: | They introduce a human-curated benchmark of over 5,800 triples of images along with parallel captions in English and regional languages. |
| Outcome: | The results show that visual context improves translation quality in culturally-specific items . |
Revisiting Context Choices for Context-aware Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent work has cast doubt on whether context-aware machine translation models learn useful signals from context or are improvements in automatic evaluation metrics just a side-effect. |
| Approach: | They propose to use separate encoders for source sentence and context as multiple sources for one target sentence to train context-aware machine translation models. |
| Outcome: | The proposed model improves translation quality even with empty lines as context, but the correct context improves it and random out-of-domain context degrades it. |
Watching the Watchers: Exposing Gender Disparities in Machine Translation Quality Estimation (2025.acl-long)
Copied to clipboard
| Challenge: | Qualitative estimation (QE) metrics have been optimized to align with human quality judgments, but whether they encode social biases has been largely overlooked. |
| Approach: | They define and investigate gender bias of QE metrics and discuss its downstream implications for machine translation (MT) when a human entity’s gender in the source is undisclosed, masculine-inflected translations score higher than feminine-infflectes translations are penalized. |
| Outcome: | The proposed measures are based on gender-based quality estimation metrics across multiple domains, datasets, and languages. |
Exploring In-context Example Generation for Machine Translation (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated strong performance across various tasks with just a few examples. |
| Approach: | They propose a method that generates in-context example pairs without external resources. |
| Outcome: | The proposed method builds upon two prior criteria, relevance and diversity, which have been highlighted as key factors for in-context example selection. |
Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on large language models focus on literal-level translation quality, such as adequacy and fluency. |
| Approach: | They propose a Culture-Aware Novel-Driven Parallel Dataset for Machine Translation and a multi-dimensional evaluation framework for assessing cultural translation quality. |
| Outcome: | The proposed model improves evaluation reliability in LLM-as-a-judge scenarios under culture-aware constraints. |
Leveraging Loanword Constraints for Improving Machine Translation in a Low-Resource Multilingual Context (2025.emnlp-main)
Copied to clipboard
| Challenge: | a recent study addresses the challenge of adapting loanwords during the translation process in low-resource languages. |
| Approach: | They propose a method that augments source sentences with loanword constraints . they then integrate loanwords as external linguistic knowledge into machine translation systems . |
| Outcome: | The proposed approach improves translation quality and handling loanword adaptation correctly in target languages. |
Understanding How Positional Encodings Work in Transformer Model (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have reported superiority of relative PEs in translation tasks. |
| Approach: | They analyze in which part of a transformer model PEs work and compare them using experiments . they find that relative PEs should be added only to query and key of attention mechanism . |
| Outcome: | The results show that relative and absolute PEs work in a transformer model, and should be added to the query and key of an attention mechanism, not to the value. |
LiTransProQA: An LLM-based Literary Translation Evaluation Metric with Professional Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation metrics for literature prioritize mechanical accuracy over artistic expression . this bias could result in an irreversible decline in translation quality and cultural authenticity . |
| Approach: | They propose a novel, reference-free, LLM-based question-answering framework for literary translation evaluation. |
| Outcome: | a novel, reference-free, LLM-based question-answering framework is developed for literary translation evaluation. |
Unmasking Biases: Exploring Gender Bias in English-Catalan Machine Translation through Tokenization Analysis and Novel Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | a new dataset focuses on gender-neutral terms that necessitate gendered translations in Catalan. |
| Approach: | They propose to use a new dataset to evaluate gender bias in machine translation . they train four MT systems using different tokenization techniques . |
| Outcome: | The proposed dataset focuses on gender-neutral terms necessitating gendered translations in Catalan. |
Utilizing Longer Context than Speech Bubbles in Automated Manga Translation (2024.lrec-main)
Copied to clipboard
Hiroto Kaino, Soichiro Sugihara, Tomoyuki Kajiwara, Takashi Ninomiya, Joshua B. Tanner, Shonosuke Ishiwatari
| Challenge: | Existing methods to capture contextual information for manga machine translation are difficult to perform . unofficially translated pirated copies of manga are circulating overseas in large numbers . |
| Approach: | They propose two new ways to capture broader contextual information in manga machine translation . scene-based translation considers previous scene and broader context information . detailed analysis reveals the effect of zero-anaphora resolution in translation - highlighting the usefulness of longer contextual information if manga is translated in Japanese . |
| Outcome: | The proposed methods improve translation quality for manga (Japanese-style comics) the results show that the combined methods achieve the highest quality. |
Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languages (2025.acl-long)
Copied to clipboard
Ashwin Sankar, Sparsh Jain, Nikhil Narasimhan, Devilal Choudhary, Dhairya Suman, Mohammed Safi Ur Rahman Khan, Anoop Kunchukuttan, Mitesh M Khapra, Raj Dabre
| Challenge: | Existing datasets that cover only a fraction of Indian languages lack the breadth needed to generalize beyond curated benchmarks. |
| Approach: | They propose to build the largest speech translation dataset for Indian languages . they use a three-step methodology to gather data and train a model that performs better . |
| Outcome: | The proposed model improves on existing models and is open-source with permissive licenses. |
Just Use XML: Revisiting Joint Translation and Label Projection (2026.findings-acl)
Copied to clipboard
| Challenge: | Label projection is an effective technique for cross-lingual transfer, extending span-annotated datasets from high-resource languages to low-resourced ones. |
| Approach: | They propose a framework that performs translation and label projection via XML tags. |
| Outcome: | The proposed framework outperforms baselines and improves translation quality across languages and annotation complexity. |
Translating Domain-Specific Terminology in Typologically-Diverse Languages: A Study in Tax and Financial Education (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing public terminology datasets for MT research are limited in language coverage or domain specificity, making it difficult to assess or improve MT systems in specialized settings. |
| Approach: | They propose a multilingual terminology resource for tax and financial education covering seven typologically diverse languages: English, Spanish, Russian, Vietnamese, Korean, Chinese (traditional and simplified) and Haitian Creole. |
| Outcome: | The proposed terminology resource covers seven typologically diverse languages: English, Spanish, Russian, Vietnamese, Korean, Chinese (traditional and simplified) and Haitian Creole. |
No One Fits All: From Fixed Prompting to Learned Routing in Multilingual LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that translation-based prompting is not universally optimal for multilingual LLMs. |
| Approach: | They evaluate translation-based prompting across ten languages and four benchmarks . they propose a lightweight classifier that predicts whether native or translation- based prompts are optimal . |
| Outcome: | The proposed classifiers achieve statistically significant improvements over fixed prompting strategies across ten languages and four benchmarks. |